Sep 28 14:52:26 devstack cinder-volume[75531]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:52:26 devstack cinder-volume[75531]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:52:26 devstack cinder-volume[75531]: we strongly recommend against using it for new projects. Sep 28 14:52:26 devstack cinder-volume[75531]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:52:26 devstack cinder-volume[75531]: framework. For more detail see Sep 28 14:52:26 devstack cinder-volume[75531]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:52:26 devstack cinder-volume[75531]: import eventlet # noqa Sep 28 14:52:29 devstack cinder-volume[75531]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:52:29 devstack cinder-volume[75531]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:52:29 devstack cinder-volume[75531]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:52:30 devstack cinder-volume[75531]: INFO dbcounter [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Registered counter for database cinder Sep 28 14:52:30 devstack cinder-volume[75531]: DEBUG oslo_db.sqlalchemy.engines [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:30 devstack cinder-volume[75531]: DEBUG dbcounter [-] [75531] Writer thread running {{(pid=75531) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:52:30 devstack cinder-volume[75531]: INFO cinder.rpc [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:52:30 devstack cinder-volume[75531]: INFO cinder.rpc [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:52:30 devstack cinder-volume[75531]: DEBUG oslo_db.sqlalchemy.engines [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:30 devstack cinder-volume[75531]: INFO cinder.volume.manager [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Determined volume DB was empty at startup. Sep 28 14:52:30 devstack cinder-volume[75531]: DEBUG cinder.volume.manager [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75531) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:52:30 devstack cinder-volume[75531]: INFO cinder.volume.manager [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:52:30 devstack cinder-volume[75531]: WARNING stevedore.named [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:52:30 devstack cinder-volume[75531]: WARNING castellan.key_manager [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:52:30 devstack cinder-volume[75531]: WARNING cinder.keymgr.conf_key_mgr [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:52:30 devstack cinder-volume[75531]: DEBUG cinder.volume.drivers.lvm [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75531) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 14:52:30 devstack cinder-volume[75531]: DEBUG oslo_concurrency.processutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75531) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_concurrency.processutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] CMD "cinder-rtstool verify" returned: 0 in 0.439s {{(pid=75531) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_db.sqlalchemy.engines [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:31 devstack cinder-volume[75531]: INFO cinder.rpc [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 14:52:31 devstack cinder-volume[75531]: INFO cinder.rpc [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 14:52:31 devstack cinder-volume[75531]: WARNING stevedore.named [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:52:31 devstack cinder-volume[75531]: WARNING castellan.key_manager [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:52:31 devstack cinder-volume[75531]: INFO cinder.volume.manager [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_db.sqlalchemy.engines [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:31 devstack cinder-volume[75531]: INFO oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Starting 1 workers Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Started child 75693 {{(pid=75531) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Full set of CONF: {{(pid=75531) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] ******************************************************************************** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Configuration options gathered from: {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] ================================================================================ {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:52:31 devstack cinder-volume[75693]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] allow_availability_zone_fallback = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] allow_compression_on_image_upload = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] allowed_direct_url_schemes = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] api_rate_limit = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] auth_strategy = keystone {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] az_cache_duration = 3600 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_availability_zone = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_host = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_stats_polling_interval = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backup_api_class = cinder.backup.api.API {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backup_name_template = backup-%s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backup_use_same_host = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backup_use_temp_snapshot = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] chap_password = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] chap_username = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_internal_tenant_project_id = 13d8c739677f4779b795d9d5c0ee7f32 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_internal_tenant_user_id = bf38b2e0fbb342f3b1caa6fd539917f7 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cloned_volume_same_az = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cluster = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] compression_format = gzip {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] compute_api_class = cinder.compute.nova.API {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] config_dir = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] config_source = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] control_exchange = openstack {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] debug = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] default_availability_zone = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] default_group_type = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] default_volume_type = lvmdriver-1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] disk_geometry = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] driver_client_cert = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] driver_client_cert_key = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] driver_data_namespace = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] driver_ssl_cert_path = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] driver_ssl_cert_verify = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] driver_use_ssl = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] enable_force_upload = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] enable_new_services = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] enable_unsupported_driver = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] enabled_backends = ['lvmdriver-1'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] enforce_multipath_for_image_xfer = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] filter_function = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_api_insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_api_servers = ['http://192.168.122.54/image'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_api_ssl_compression = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_ca_certificates_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_catalog_info = image:glance:publicURL {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75693]: INFO cinder.volume.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_num_retries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance_request_timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] goodness_function = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] graceful_shutdown_timeout = 5 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] group_api_class = cinder.group.api.API {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] host = devstack {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_compress_on_upload = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_conversion_address_space_limit = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_conversion_cpu_limit = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_conversion_disable = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_introspection_address_space_limit = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_introspection_cpu_limit = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_upload_use_cinder_backend = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_upload_use_internal_tenant = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_volume_cache_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_volume_cache_max_count = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] image_volume_cache_max_size_gb = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] init_host_max_objects_retrieval = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] instance_format = [instance: %(uuid)s] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] iscsi_target_flags = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] iscsi_write_cache = on {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] iser_helper = tgtadm {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] iser_ip_address = 192.168.122.54 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] iser_port = 3260 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_color = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_config_append = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_dir = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_options = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_rotate_interval = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_rotate_interval_type = days {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] log_rotation_type = none {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] max_age = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] max_logfile_count = 30 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] max_logfile_size_mb = 200 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] max_over_subscription_ratio = 20.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] message_reap_interval = 86400 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] message_ttl = 2592000 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] migration_create_volume_timeout_secs = 300 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] monkey_patch = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] monkey_patch_modules = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] my_ip = 192.168.122.54 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] no_snapshot_gb_quota = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] num_iser_scan_tries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] num_shell_tries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] num_volume_device_scan_tries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] nvmeof_conn_info_version = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] nvmet_ns_id = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] nvmet_port_id = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_max_limit = 1000 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_volume_ext_list = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_volume_listen = 0.0.0.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_volume_listen_port = 8776 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_volume_use_ssl = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] osapi_volume_workers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] per_volume_size_limit = -1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] periodic_fuzzy_delay = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] periodic_interval = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] project_id_regex = [0-9a-f\-]+ {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] public_endpoint = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] publish_errors = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_backup_gigabytes = 1000 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_backups = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_gigabytes = 1000 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_groups = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_snapshots = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] quota_volumes = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] rate_limit_burst = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] rate_limit_except_level = CRITICAL {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] rate_limit_interval = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] reinit_driver_count = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] replication_device = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] report_discard_supported = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] report_interval = 120 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] reservation_clean_interval = 86400 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] reservation_expire = 86400 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] reserved_image_namespaces = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] reserved_percentage = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] rpc_response_timeout = 120 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] run_external_periodic_tasks = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] scst_target_driver = iscsi {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] scst_target_iqn_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_down_time = 720 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] shell_completion = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] snapshot_name_template = snapshot-%s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] snapshot_same_host = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] split_loggers = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] state_path = /opt/stack/data/cinder {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] storage_availability_zone = nova {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] storage_protocol = iSCSI {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] syslog_log_facility = LOG_USER {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] target_helper = lioadm {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] target_ip_address = 192.168.122.54 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] target_port = 3260 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] target_protocol = iscsi {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] target_secondary_ip_addresses = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] trace_flags = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] transfer_api_class = cinder.transfer.api.API {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] transport_url = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] until_refresh = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_chap_auth = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_default_quota_class = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_journal = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_json = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_multipath_for_image_xfer = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_stderr = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:31 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] use_syslog = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] verify_glance_signatures = enabled {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_api_class = cinder.volume.api.API {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_backend_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_clear = zero {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_clear_ionice = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_clear_size = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_copy_bps_limit = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_dd_blocksize = 1M {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_name_template = volume-%s {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_service_inithost_offload = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volume_usage_audit_period = month {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] zoning_mode = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_concurrency.disable_process_locking = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.auth_section = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.auth_type = password {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.auth_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.cache = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.delay_auth_decision = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack sudo[75697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.http_connect_timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack sudo[75697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.include_service_catalog = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.interface = public {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_password = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcache_username = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.region_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.service_token_roles_required = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.service_type = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.token_cache_time = 300 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.54/identity {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.backend = dogpile.cache.null {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.backend_argument = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.backend_expiration_time = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.config_prefix = cache.oslo {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.debug_cache_backend = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.enable_retry_client = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.enable_socket_keepalive = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.expiration_time = 600 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.hashclient_retry_attempts = 2 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_dead_retry = 300 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_pool_maxsize = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_sasl_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.password = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.proxies = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.redis_db = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.redis_sentinel_service_name = mymaster {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.redis_server = localhost:6379 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.retry_attempts = 2 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.retry_delay = 0.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.socket_keepalive_count = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.socket_keepalive_idle = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.socket_keepalive_interval = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.socket_timeout = 1.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.tls_allowed_ciphers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.tls_cafile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.tls_certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.tls_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.tls_keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cache.username = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] coordination.backend_url = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.asyncio_connection = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.asyncio_slave_connection = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.backend = sqlalchemy {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.connection = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.connection_debug = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.connection_parameters = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.connection_recycle_time = 3600 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.connection_trace = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.db_inc_retry_interval = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.db_max_retries = 20 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.db_max_retry_interval = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.db_retry_interval = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.max_overflow = 50 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.max_pool_size = 5 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.max_retries = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.mysql_wsrep_sync_wait = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.pool_timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.retry_interval = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.slave_connection = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.sqlite_synchronous = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.synchronous_reader = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] database.use_db_reconnect = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_tracing.insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.connection_string = messaging:// {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.es_doc_type = notification {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.es_scroll_size = 10000 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.es_scroll_time = 2m {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.filter_error_trace = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.hmac_keys = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.sentinel_service_name = mymaster {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.socket_timeout = 0.1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.trace_requests = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler.trace_sqlalchemy = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler_jaeger.process_tags = {} {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler_jaeger.service_name_prefix = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] profiler_otlp.service_name_prefix = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.enforce_new_defaults = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.policy_default_rule = default {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.policy_file = policy.yaml {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_policy.remote_timeout = 60.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.group = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.helper_command = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] privsep_osbrick.user = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.group = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.helper_command = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] cinder_sys_admin.user = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.auth_section = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.auth_type = password {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.cafile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.collect_timing = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.send_service_user_token = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.split_loggers = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.tls_ciphers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] service_user.tls_min_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.auth_section = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.auth_type = password {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.collect_timing = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.region_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.split_loggers = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.tls_ciphers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] glance.tls_min_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.backend_availability_zone = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.chap_password = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.chap_username = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.disk_geometry = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.driver_client_cert = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.driver_client_cert_key = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.driver_data_namespace = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.driver_use_ssl = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.enable_unsupported_driver = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.extra_capabilities = {} {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.filter_function = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.goodness_function = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.iscsi_target_flags = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.iscsi_write_cache = on {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.iser_helper = tgtadm {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.iser_ip_address = 192.168.122.54 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.iser_port = 3260 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.lvm_mirrors = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.lvm_share_target = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.lvm_type = auto {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.num_shell_tries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.nvmet_port_id = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.replication_device = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.report_discard_supported = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.reserved_percentage = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.scst_target_driver = iscsi {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.scst_target_iqn_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.storage_protocol = iSCSI {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.target_helper = tgtadm {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.target_ip_address = 192.168.122.54 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.target_port = 3260 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.target_protocol = iscsi {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.trace_flags = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.unique_fqdn_network = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.use_chap_auth = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_backend_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_clear = zero {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_clear_ionice = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_clear_size = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volume_group = cinder-volumes {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_reports.file_event_handler = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_reports.log_dir = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.backend_availability_zone = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.backend_host = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:31 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.chap_password = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.chap_username = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.chiscsi_conf = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.disk_geometry = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.driver_client_cert = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.driver_data_namespace = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.driver_use_ssl = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.extra_capabilities = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.filter_function = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.goodness_function = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.iser_helper = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.iser_ip_address = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.iser_port = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.iser_target_prefix = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.lvm_conf_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.lvm_mirrors = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.lvm_share_target = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.lvm_type = auto {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.num_shell_tries = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.nvmet_port_id = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.replication_device = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.report_discard_supported = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.reserved_percentage = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.scst_target_driver = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.storage_protocol = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.target_helper = lioadm {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.target_ip_address = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.target_port = 3260 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.target_protocol = iscsi {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.trace_flags = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.use_chap_auth = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_clear = zero {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_clear_size = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] lvmdriver-1.volumes_dir = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.ssl_version = {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_notifications.driver = [] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_notifications.retry = -1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] key_manager.fixed_key = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.barbican_api_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.barbican_endpoint = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.barbican_endpoint_type = public {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.barbican_region_name = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.cafile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.collect_timing = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.number_of_retries = 60 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.retry_delay = 1 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.send_service_user_token = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.split_loggers = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.tls_ciphers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.tls_min_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.verify_ssl = True {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican.verify_ssl_path = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.auth_section = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.auth_type = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.cafile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.certfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.collect_timing = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.insecure = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.keyfile = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.split_loggers = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.timeout = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.tls_ciphers = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] barbican_service_user.tls_min_version = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.approle_role_id = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.approle_secret_id = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.auth_method = approle {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.auth_path = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.kv_mountpoint = secret {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.kv_path = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.kv_version = 2 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.namespace = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.root_token_id = **** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.ssl_ca_crt_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.timeout = 60.0 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.token_file = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.token_role = None {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.use_ssl = False {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:52:32 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] ******************************************************************************** {{(pid=75531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:52:32 devstack sudo[75697]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:32 devstack sudo[75794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:32 devstack sudo[75794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:32 devstack sudo[75794]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.298s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 14:52:32 devstack cinder-volume[75693]: INFO cinder.brick.local_dev.lvm [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:32 devstack sudo[75915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:32 devstack sudo[75915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:32 devstack sudo[75915]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG cinder.brick.local_dev.lvm [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75693) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 14:52:32 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:32 devstack sudo[75988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:32 devstack sudo[75988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:33 devstack sudo[75988]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.558s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:33 devstack sudo[76186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:33 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:33 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:33 devstack sudo[76308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 14:52:33 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:33 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:33 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:33 devstack sudo[76311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:33 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:34 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:34 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:34 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:34 devstack sudo[76387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:34 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:34 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:34 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:34 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:34 devstack sudo[76398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:34 devstack sudo[76398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:34 devstack sudo[76398]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:34 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:34 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:34 devstack sudo[76421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:34 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:35 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:35 devstack sudo[76491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:35 devstack sudo[76491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:35 devstack sudo[76491]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:35 devstack cinder-volume[75693]: INFO cinder.volume.drivers.lvm [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:35 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:35 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:35 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:52:35 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:35 devstack sudo[76498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:35 devstack sudo[76498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:36 devstack sudo[76498]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:36 devstack sudo[76507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:36 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:36 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:36 devstack sudo[76510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:36 devstack sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:36 devstack sudo[76510]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:36 devstack sudo[76513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:36 devstack sudo[76513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:36 devstack sudo[76513]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:36 devstack cinder-volume[75693]: INFO cinder.volume.driver [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG cinder.volume.driver [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75693) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:52:36 devstack cinder-volume[75693]: DEBUG oslo_db.sqlalchemy.engines [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG dbcounter [-] [75693] Writer thread running {{(pid=75693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG cinder.db.api [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Building query based on filter {{(pid=75693) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG cinder.image.image_utils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75693) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:52:37 devstack cinder-volume[75693]: INFO cinder.keymgr.migration [None req-a953bb94-891c-44bb-b541-ec985d5deaed None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:37 devstack sudo[76516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:37 devstack sudo[76516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:37 devstack sudo[76516]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:37 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:37 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:37 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:37 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:37 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:37 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:37 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:37 devstack sudo[76528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:37 devstack sudo[76528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:38 devstack sudo[76528]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG cinder.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Notifying Schedulers of capabilities ... {{(pid=75693) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:52:38 devstack cinder-volume[75693]: INFO cinder.volume.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Driver initialization completed successfully. Sep 28 14:52:38 devstack cinder-volume[75693]: INFO cinder.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Initiating service 2 cleanup Sep 28 14:52:38 devstack cinder-volume[75693]: INFO cinder.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Service 2 cleanup completed. Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG cinder.service [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Creating RPC server for service cinder-volume {{(pid=75693) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG cinder.service [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75693) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:52:38 devstack cinder-volume[75693]: INFO cinder.volume.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:38 devstack sudo[76532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:38 devstack sudo[76532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:38 devstack sudo[76532]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:38 devstack sudo[76536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:38 devstack sudo[76536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:38 devstack sudo[76536]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:38 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:38 devstack sudo[76540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:38 devstack sudo[76540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:39 devstack sudo[76540]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:39 devstack sudo[76543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:39 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:39 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:39 devstack cinder-volume[75693]: INFO cinder.volume.manager [None req-161c2d04-8427-429e-87a9-8690714d3938 None None] Driver post RPC initialization completed successfully. Sep 28 14:52:41 devstack cinder-volume[75531]: DEBUG dbcounter [-] [75531] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75531) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:52:48 devstack cinder-volume[75693]: DEBUG dbcounter [-] [75693] Writing DB stats cinder:SELECT=3 {{(pid=75693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:52:49 devstack cinder-volume[75693]: DEBUG dbcounter [-] [75693] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:39 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:39 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:39 devstack sudo[78486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:39 devstack sudo[78486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:39 devstack sudo[78486]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:39 devstack sudo[78489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:39 devstack sudo[78489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:40 devstack sudo[78489]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:40 devstack sudo[78492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:40 devstack sudo[78492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:40 devstack sudo[78492]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:40 devstack sudo[78495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:40 devstack sudo[78495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:40 devstack sudo[78495]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG cinder.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Notifying Schedulers of capabilities ... {{(pid=75693) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager._thread_info {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG cinder.volume.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] thread count: 6 {{(pid=75693) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:53:40 devstack cinder-volume[75693]: DEBUG cinder.volume.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] thread info: [<_MainThread(MainThread, started 137993413566592)>, , , , , ] {{(pid=75693) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:54:39 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:39 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:54:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:39 devstack sudo[81837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:54:39 devstack sudo[81837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:39 devstack sudo[81837]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:39 devstack sudo[81841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:39 devstack sudo[81841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:40 devstack sudo[81841]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:40 devstack sudo[81844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:54:40 devstack sudo[81844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:40 devstack sudo[81844]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:40 devstack sudo[81848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:40 devstack sudo[81848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:40 devstack sudo[81848]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG cinder.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Notifying Schedulers of capabilities ... {{(pid=75693) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager._thread_info {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG cinder.volume.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] thread count: 6 {{(pid=75693) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:54:40 devstack cinder-volume[75693]: DEBUG cinder.volume.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] thread info: [<_MainThread(MainThread, started 137993413566592)>, , , , , ] {{(pid=75693) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:54:49 devstack cinder-volume[75693]: DEBUG dbcounter [-] [75693] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:39 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:39 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:55:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:39 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:55:39 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:39 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:39 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:39 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:40 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:40 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:55:40 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:40 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:40 devstack sudo[84273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:40 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:40 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:40 devstack cinder-volume[75693]: DEBUG cinder.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Notifying Schedulers of capabilities ... {{(pid=75693) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:39 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:39 devstack cinder-volume[75693]: DEBUG cinder.volume.drivers.lvm [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Updating volume stats {{(pid=75693) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:56:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:39 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:56:39 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:39 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:39 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:39 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:56:39 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:40 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:40 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:56:40 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:40 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:40 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:56:40 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:40 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG oslo_concurrency.processutils [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75693) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG cinder.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Notifying Schedulers of capabilities ... {{(pid=75693) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG oslo_service.periodic_task [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] Running periodic task VolumeManager._thread_info {{(pid=75693) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG cinder.volume.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] thread count: 6 {{(pid=75693) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:56:40 devstack cinder-volume[75693]: DEBUG cinder.volume.manager [None req-cb2dddd1-c586-425f-88ca-a6988b0edd41 None None] thread info: [<_MainThread(MainThread, started 137993413566592)>, , , , , ] {{(pid=75693) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:56:49 devstack cinder-volume[75693]: DEBUG dbcounter [-] [75693] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:06 devstack cinder-volume[75531]: INFO oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Caught SIGTERM, stopping children Sep 28 14:57:06 devstack cinder-volume[75531]: DEBUG oslo_concurrency.lockutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Acquiring lock "singleton_lock" {{(pid=75531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:57:06 devstack cinder-volume[75531]: DEBUG oslo_concurrency.lockutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Acquired lock "singleton_lock" {{(pid=75531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:57:06 devstack cinder-volume[75531]: DEBUG oslo_concurrency.lockutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Releasing lock "singleton_lock" {{(pid=75531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:57:06 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Stop services. {{(pid=75531) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:57:06 devstack cinder-volume[75531]: DEBUG oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Killing children. {{(pid=75531) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:57:06 devstack cinder-volume[75531]: INFO oslo_service.backend._eventlet.service [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Waiting on 1 children to exit Sep 28 14:57:11 devstack cinder-volume[75693]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 14:57:11 devstack cinder-volume[86060]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:57:11 devstack cinder-volume[86060]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:57:11 devstack cinder-volume[86060]: we strongly recommend against using it for new projects. Sep 28 14:57:11 devstack cinder-volume[86060]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:57:11 devstack cinder-volume[86060]: framework. For more detail see Sep 28 14:57:11 devstack cinder-volume[86060]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:57:11 devstack cinder-volume[86060]: import eventlet # noqa Sep 28 14:57:13 devstack cinder-volume[75693]: DEBUG oslo_concurrency.lockutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Acquiring lock "singleton_lock" {{(pid=75693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:57:13 devstack cinder-volume[75693]: DEBUG oslo_concurrency.lockutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Acquired lock "singleton_lock" {{(pid=75693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:57:13 devstack cinder-volume[75693]: DEBUG oslo_concurrency.lockutils [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Releasing lock "singleton_lock" {{(pid=75693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:57:13 devstack cinder-volume[75693]: WARNING amqp [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:57:13 devstack cinder-volume[75693]: WARNING amqp [None req-98388877-9c00-47f8-926a-9b6b7d69a6ba None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:57:13 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:57:13 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:57:13 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:57:14 devstack cinder-volume[86060]: INFO dbcounter [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Registered counter for database cinder Sep 28 14:57:14 devstack cinder-volume[86060]: DEBUG oslo_db.sqlalchemy.engines [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:14 devstack cinder-volume[86060]: DEBUG dbcounter [-] [86060] Writer thread running {{(pid=86060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:57:14 devstack cinder-volume[86060]: INFO cinder.rpc [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:57:14 devstack cinder-volume[86060]: INFO cinder.rpc [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:57:14 devstack cinder-volume[86060]: DEBUG oslo_db.sqlalchemy.engines [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:14 devstack cinder-volume[86060]: INFO cinder.volume.manager [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Determined volume DB was empty at startup. Sep 28 14:57:14 devstack cinder-volume[86060]: DEBUG cinder.volume.manager [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86060) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:57:14 devstack cinder-volume[86060]: INFO cinder.volume.manager [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:57:14 devstack cinder-volume[86060]: WARNING stevedore.named [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:57:14 devstack cinder-volume[86060]: WARNING castellan.key_manager [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:57:14 devstack cinder-volume[86060]: WARNING cinder.keymgr.conf_key_mgr [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:57:14 devstack cinder-volume[86060]: INFO cinder.volume.manager [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_db.sqlalchemy.engines [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:15 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Starting 1 workers Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Started child 86283 {{(pid=86060) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Full set of CONF: {{(pid=86060) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] ******************************************************************************** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Configuration options gathered from: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:57:15 devstack cinder-volume[86283]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] ================================================================================ {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] allow_availability_zone_fallback = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] allow_compression_on_image_upload = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] allowed_direct_url_schemes = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] api_rate_limit = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] auth_strategy = keystone {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_availability_zone = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_host = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_stats_polling_interval = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backup_api_class = cinder.backup.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backup_name_template = backup-%s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backup_use_same_host = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backup_use_temp_snapshot = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] chap_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] chap_username = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_internal_tenant_project_id = 13d8c739677f4779b795d9d5c0ee7f32 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_internal_tenant_user_id = bf38b2e0fbb342f3b1caa6fd539917f7 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cluster = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] compression_format = gzip {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] compute_api_class = cinder.compute.nova.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] config_dir = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] config_source = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] control_exchange = openstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] debug = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] default_availability_zone = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] default_group_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] default_volume_type = QuobyteHD {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] disk_geometry = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] driver_client_cert = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] driver_client_cert_key = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] driver_data_namespace = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] driver_ssl_cert_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] driver_ssl_cert_verify = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] driver_use_ssl = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] enable_new_services = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] enable_unsupported_driver = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] enabled_backends = ['QuobyteHD'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] enforce_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] filter_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_api_insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_api_servers = ['http://192.168.122.54/image'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_api_ssl_compression = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_ca_certificates_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_catalog_info = image:glance:publicURL {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_num_retries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance_request_timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] goodness_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] graceful_shutdown_timeout = 5 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] group_api_class = cinder.group.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] host = devstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_compress_on_upload = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_conversion_address_space_limit = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_conversion_cpu_limit = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_conversion_disable = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_introspection_address_space_limit = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_introspection_cpu_limit = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_upload_use_cinder_backend = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_upload_use_internal_tenant = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_volume_cache_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_volume_cache_max_count = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] image_volume_cache_max_size_gb = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] init_host_max_objects_retrieval = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] instance_format = [instance: %(uuid)s] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] iscsi_target_flags = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] iscsi_write_cache = on {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] iser_helper = tgtadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] iser_ip_address = 192.168.122.54 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] iser_port = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_color = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_config_append = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_dir = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_options = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_rotate_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.remotefs [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86283) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_rotate_interval_type = days {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] log_rotation_type = none {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] max_age = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] max_logfile_count = 30 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] max_logfile_size_mb = 200 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] max_over_subscription_ratio = 20.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] message_reap_interval = 86400 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] message_ttl = 2592000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] migration_create_volume_timeout_secs = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] monkey_patch = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] monkey_patch_modules = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] my_ip = 192.168.122.54 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] no_snapshot_gb_quota = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] num_iser_scan_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] num_shell_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] num_volume_device_scan_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] nvmeof_conn_info_version = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] nvmet_ns_id = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] nvmet_port_id = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_max_limit = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_volume_ext_list = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_volume_listen_port = 8776 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_volume_use_ssl = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] osapi_volume_workers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] per_volume_size_limit = -1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] periodic_fuzzy_delay = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] periodic_interval = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] public_endpoint = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] publish_errors = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_backup_gigabytes = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_backups = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_gigabytes = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_groups = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_snapshots = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] quota_volumes = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] rate_limit_burst = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] rate_limit_except_level = CRITICAL {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] rate_limit_interval = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] reinit_driver_count = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] replication_device = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] report_discard_supported = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] report_interval = 120 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] reservation_clean_interval = 86400 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] reservation_expire = 86400 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] reserved_image_namespaces = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] reserved_percentage = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] rpc_response_timeout = 120 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] run_external_periodic_tasks = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] scst_target_driver = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] scst_target_iqn_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_down_time = 720 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] shell_completion = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] snapshot_name_template = snapshot-%s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] split_loggers = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] state_path = /opt/stack/data/cinder {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] storage_availability_zone = nova {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] storage_protocol = iSCSI {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] syslog_log_facility = LOG_USER {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] target_helper = lioadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] target_ip_address = 192.168.122.54 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] target_port = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] target_protocol = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] target_secondary_ip_addresses = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] trace_flags = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] transport_url = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] until_refresh = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_chap_auth = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_default_quota_class = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_journal = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_json = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_stderr = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] use_syslog = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] verify_glance_signatures = enabled {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_api_class = cinder.volume.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_backend_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_clear = zero {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_clear_ionice = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_clear_size = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_copy_bps_limit = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_dd_blocksize = 1M {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_name_template = volume-%s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_service_inithost_offload = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volume_usage_audit_period = month {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] zoning_mode = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_concurrency.disable_process_locking = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.auth_section = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.auth_type = password {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.auth_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.cache = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.include_service_catalog = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.interface = public {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcache_username = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.region_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.service_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.54/identity {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.backend = dogpile.cache.null {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.backend_argument = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.backend_expiration_time = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.config_prefix = cache.oslo {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.debug_cache_backend = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.enable_retry_client = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.enable_socket_keepalive = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.expiration_time = 600 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.hashclient_retry_attempts = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_dead_retry = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_pool_maxsize = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_sasl_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.proxies = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.redis_db = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.redis_server = localhost:6379 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.retry_attempts = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.retry_delay = 0.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.socket_keepalive_count = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.socket_keepalive_idle = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.socket_keepalive_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.socket_timeout = 1.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.tls_allowed_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.tls_cafile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.tls_certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.tls_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.tls_keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cache.username = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86283) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] coordination.backend_url = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: WARNING cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:57:15 devstack cinder-volume[86283]: WARNING cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.asyncio_connection = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.asyncio_slave_connection = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.backend = sqlalchemy {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.connection = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Running cmd (subprocess): mount.quobyte {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.connection_debug = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.connection_parameters = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.connection_recycle_time = 3600 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.connection_trace = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.db_inc_retry_interval = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.db_max_retries = 20 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.db_max_retry_interval = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.db_retry_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.max_overflow = 50 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.max_pool_size = 5 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.max_retries = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.mysql_wsrep_sync_wait = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.pool_timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.retry_interval = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.slave_connection = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.sqlite_synchronous = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.synchronous_reader = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] database.use_db_reconnect = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_tracing.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.connection_string = messaging:// {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.es_doc_type = notification {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.es_scroll_size = 10000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.es_scroll_time = 2m {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.filter_error_trace = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.hmac_keys = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.sentinel_service_name = mymaster {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.socket_timeout = 0.1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.trace_requests = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler.trace_sqlalchemy = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler_jaeger.process_tags = {} {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler_jaeger.service_name_prefix = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] profiler_otlp.service_name_prefix = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.enforce_new_defaults = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.policy_default_rule = default {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.policy_file = policy.yaml {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.group = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.helper_command = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] privsep_osbrick.user = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.group = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.helper_command = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] cinder_sys_admin.user = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.auth_section = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.auth_type = password {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.cafile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.collect_timing = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.send_service_user_token = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.split_loggers = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.tls_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] service_user.tls_min_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.auth_section = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.auth_type = password {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.collect_timing = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.region_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.split_loggers = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.tls_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] glance.tls_min_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.backend_availability_zone = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.chap_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.chap_username = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.disk_geometry = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.driver_client_cert = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.driver_client_cert_key = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.driver_data_namespace = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.driver_use_ssl = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.extra_capabilities = {} {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.filter_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.goodness_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.iscsi_target_flags = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.iscsi_write_cache = on {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.iser_helper = tgtadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.iser_ip_address = 192.168.122.54 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.iser_port = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_host = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_login = admin {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_mount_options = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_private_key = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_share_path = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.num_shell_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.quobyte_volume_url = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.replication_device = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.report_discard_supported = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.reserved_percentage = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.target_helper = tgtadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.target_ip_address = 192.168.122.54 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.target_port = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.target_protocol = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.trace_flags = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.unique_fqdn_network = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.use_chap_auth = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_backend_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_clear = zero {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_clear_ionice = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_clear_size = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_reports.file_event_handler = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_reports.log_dir = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.backend_availability_zone = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.backend_host = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.chap_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.chap_username = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.chiscsi_conf = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.disk_geometry = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.driver_client_cert = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.driver_data_namespace = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.driver_use_ssl = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.extra_capabilities = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.filter_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.goodness_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.iser_helper = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.iser_ip_address = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.iser_port = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.iser_target_prefix = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_host = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_login = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_mount_options = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_private_key = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_share_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_ssh_port = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack quobyte-client[86288]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.num_shell_tries = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack quobyte-client[86288]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.nvmet_port_id = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.replication_device = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.report_discard_supported = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.reserved_percentage = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.scst_target_driver = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=86283) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.storage_protocol = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.target_helper = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: INFO cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 ... Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.target_ip_address = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.target_port = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.target_prefix = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 -c /etc/quobyte/client-cinder.cfg {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.target_protocol = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.trace_flags = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.use_chap_auth = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_clear = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_clear_size = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] QuobyteHD.volumes_dir = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_notifications.driver = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_notifications.retry = -1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] key_manager.fixed_key = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.barbican_api_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.barbican_endpoint = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.barbican_endpoint_type = public {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.barbican_region_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.cafile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.collect_timing = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.number_of_retries = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.retry_delay = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.send_service_user_token = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.split_loggers = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.tls_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.tls_min_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.verify_ssl = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican.verify_ssl_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 -c /etc/quobyte/client-cinder.cfg Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.auth_section = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.auth_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.cafile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.collect_timing = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.split_loggers = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.tls_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] barbican_service_user.tls_min_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.approle_role_id = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.approle_secret_id = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.auth_method = approle {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.auth_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.kv_mountpoint = secret {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.kv_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.kv_version = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.namespace = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.root_token_id = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.ssl_ca_crt_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.timeout = 60.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.token_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.token_role = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.use_ssl = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:15 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] ******************************************************************************** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:57:15 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.446s {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:15 devstack cinder-volume[86283]: INFO cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 succeeded Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=86283) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.461s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:15 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:15 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:15 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:16 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.247s {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.volume.driver [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.volume.driver [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2040061950684, 'free_capacity_gb': 1775.2040061950684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86283) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_db.sqlalchemy.engines [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG dbcounter [-] [86283] Writer thread running {{(pid=86283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.db.api [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Building query based on filter {{(pid=86283) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.image.image_utils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86283) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.keymgr.migration [None req-07f80898-54fc-4c72-9720-45958bd8ec0d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=86283) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=86283) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:16 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:16 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:16 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.255s {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Notifying Schedulers of capabilities ... {{(pid=86283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Driver initialization completed successfully. Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Initiating service 3 cleanup Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Service 3 cleanup completed. Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.service [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Creating RPC server for service cinder-volume {{(pid=86283) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.service [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86283) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=86283) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=86283) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:16 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:16 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:16 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:16 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.273s {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:16 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-a460e9fc-258f-4d28-9c43-dee625e4fd26 None None] Driver post RPC initialization completed successfully. Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=86283) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=86283) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86283) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:21 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:21 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:21 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG oslo_concurrency.processutils [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.251s {{(pid=86283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:21 devstack cinder-volume[86283]: DEBUG cinder.manager [None req-ee8a540e-9b01-4fbe-85d8-b202960a6f28 None None] Notifying Schedulers of capabilities ... {{(pid=86283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:24 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Caught SIGTERM, stopping children Sep 28 14:57:24 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Acquiring lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:57:24 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Acquired lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:57:24 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Releasing lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:57:24 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Stop services. {{(pid=86060) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:57:24 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Killing children. {{(pid=86060) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:57:24 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Waiting on 1 children to exit Sep 28 14:57:26 devstack cinder-volume[86283]: DEBUG dbcounter [-] [86283] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:26 devstack cinder-volume[86283]: DEBUG dbcounter [-] [86283] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:29 devstack cinder-volume[86283]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 14:57:29 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Acquiring lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:57:29 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Acquired lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:57:29 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Releasing lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:57:29 devstack cinder-volume[86283]: WARNING amqp [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:57:29 devstack cinder-volume[86283]: WARNING amqp [None req-d29f8c1f-dcf9-4281-8a2c-d0d610e0c63a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:57:30 devstack cinder-volume[86836]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:57:30 devstack cinder-volume[86836]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:57:30 devstack cinder-volume[86836]: we strongly recommend against using it for new projects. Sep 28 14:57:30 devstack cinder-volume[86836]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:57:30 devstack cinder-volume[86836]: framework. For more detail see Sep 28 14:57:30 devstack cinder-volume[86836]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:57:30 devstack cinder-volume[86836]: import eventlet # noqa Sep 28 14:57:32 devstack cinder-volume[86836]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:57:32 devstack cinder-volume[86836]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:57:32 devstack cinder-volume[86836]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:57:33 devstack cinder-volume[86836]: INFO dbcounter [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Registered counter for database cinder Sep 28 14:57:33 devstack cinder-volume[86836]: DEBUG oslo_db.sqlalchemy.engines [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:33 devstack cinder-volume[86836]: DEBUG dbcounter [-] [86836] Writer thread running {{(pid=86836) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:57:33 devstack cinder-volume[86836]: INFO cinder.rpc [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:57:33 devstack cinder-volume[86836]: INFO cinder.rpc [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:57:33 devstack cinder-volume[86836]: DEBUG oslo_db.sqlalchemy.engines [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:33 devstack cinder-volume[86836]: INFO cinder.volume.manager [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Determined volume DB was empty at startup. Sep 28 14:57:33 devstack cinder-volume[86836]: DEBUG cinder.volume.manager [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86836) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:57:33 devstack cinder-volume[86836]: WARNING stevedore.named [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:57:33 devstack cinder-volume[86836]: WARNING castellan.key_manager [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:57:33 devstack cinder-volume[86836]: WARNING cinder.keymgr.conf_key_mgr [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:57:33 devstack cinder-volume[86836]: INFO cinder.volume.manager [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_db.sqlalchemy.engines [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:34 devstack cinder-volume[86836]: INFO oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Starting 1 workers Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Started child 87124 {{(pid=86836) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Full set of CONF: {{(pid=86836) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] ******************************************************************************** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] Configuration options gathered from: {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] ================================================================================ {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] allow_availability_zone_fallback = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] allow_compression_on_image_upload = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] allowed_direct_url_schemes = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] api_rate_limit = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] auth_strategy = keystone {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_availability_zone = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_host = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_stats_polling_interval = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backup_api_class = cinder.backup.api.API {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backup_name_template = backup-%s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backup_use_same_host = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backup_use_temp_snapshot = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] chap_password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] chap_username = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_internal_tenant_project_id = 13d8c739677f4779b795d9d5c0ee7f32 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_internal_tenant_user_id = bf38b2e0fbb342f3b1caa6fd539917f7 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cluster = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] compression_format = gzip {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] compute_api_class = cinder.compute.nova.API {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] config_dir = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] config_source = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] control_exchange = openstack {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] debug = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] default_availability_zone = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] default_group_type = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] default_volume_type = QuobyteHD {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] disk_geometry = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] driver_client_cert = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] driver_client_cert_key = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] driver_data_namespace = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] driver_ssl_cert_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] driver_ssl_cert_verify = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] driver_use_ssl = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] enable_new_services = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] enable_unsupported_driver = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] enabled_backends = ['QuobyteHD'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] enforce_multipath_for_image_xfer = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] filter_function = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_api_insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_api_servers = ['http://192.168.122.54/image'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_api_ssl_compression = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_ca_certificates_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_catalog_info = image:glance:publicURL {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_num_retries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance_request_timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] goodness_function = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] graceful_shutdown_timeout = 5 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] group_api_class = cinder.group.api.API {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] host = devstack {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_compress_on_upload = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_conversion_address_space_limit = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_conversion_cpu_limit = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_conversion_disable = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_introspection_address_space_limit = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_introspection_cpu_limit = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_upload_use_cinder_backend = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_upload_use_internal_tenant = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_volume_cache_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_volume_cache_max_count = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] init_host_max_objects_retrieval = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] instance_format = [instance: %(uuid)s] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] iscsi_target_flags = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] iscsi_write_cache = on {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] iser_helper = tgtadm {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] iser_ip_address = 192.168.122.54 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] iser_port = 3260 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_color = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_config_append = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_dir = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_options = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_rotate_interval = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_rotate_interval_type = days {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] log_rotation_type = none {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] max_age = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] max_logfile_count = 30 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] max_logfile_size_mb = 200 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] max_over_subscription_ratio = 20.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] message_reap_interval = 86400 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] message_ttl = 2592000 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] monkey_patch = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] monkey_patch_modules = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] my_ip = 192.168.122.54 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] no_snapshot_gb_quota = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] num_iser_scan_tries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] num_shell_tries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] num_volume_device_scan_tries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] nvmeof_conn_info_version = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] nvmet_ns_id = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] nvmet_port_id = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_max_limit = 1000 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_volume_ext_list = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_volume_listen_port = 8776 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_volume_use_ssl = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87124) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] osapi_volume_workers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] per_volume_size_limit = -1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] periodic_fuzzy_delay = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] periodic_interval = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] public_endpoint = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] publish_errors = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_backup_gigabytes = 1000 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_backups = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_gigabytes = 1000 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_groups = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_snapshots = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] quota_volumes = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] rate_limit_burst = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] rate_limit_except_level = CRITICAL {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] rate_limit_interval = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] reinit_driver_count = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] replication_device = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] report_discard_supported = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] report_interval = 120 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] reservation_clean_interval = 86400 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] reservation_expire = 86400 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] reserved_image_namespaces = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] reserved_percentage = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] rpc_response_timeout = 120 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] run_external_periodic_tasks = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] scst_target_driver = iscsi {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] scst_target_iqn_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_down_time = 720 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] shell_completion = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] snapshot_name_template = snapshot-%s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] split_loggers = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] state_path = /opt/stack/data/cinder {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] storage_availability_zone = nova {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] storage_protocol = iSCSI {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] syslog_log_facility = LOG_USER {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] target_helper = lioadm {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] target_ip_address = 192.168.122.54 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] target_port = 3260 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] target_protocol = iscsi {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] target_secondary_ip_addresses = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] trace_flags = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] transport_url = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] until_refresh = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_chap_auth = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_default_quota_class = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_journal = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_json = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_multipath_for_image_xfer = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_stderr = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] use_syslog = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] verify_glance_signatures = enabled {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_api_class = cinder.volume.api.API {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_backend_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_clear = zero {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_clear_ionice = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_clear_size = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_copy_bps_limit = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_dd_blocksize = 1M {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_name_template = volume-%s {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_service_inithost_offload = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volume_usage_audit_period = month {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] zoning_mode = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.auth_section = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.auth_type = password {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.auth_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.cache = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.interface = public {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcache_username = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.region_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.service_type = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.54/identity {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.backend = dogpile.cache.null {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.backend_argument = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.backend_expiration_time = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.config_prefix = cache.oslo {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.debug_cache_backend = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.enable_retry_client = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.enable_socket_keepalive = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.expiration_time = 600 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_dead_retry = 300 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_pool_maxsize = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_sasl_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.proxies = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.redis_db = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.redis_server = localhost:6379 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.retry_attempts = 2 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.retry_delay = 0.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.socket_keepalive_count = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.socket_keepalive_idle = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.socket_keepalive_interval = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.socket_timeout = 1.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.tls_allowed_ciphers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.tls_cafile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.tls_certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.tls_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.tls_keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cache.username = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] coordination.backend_url = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87124) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.asyncio_connection = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.asyncio_slave_connection = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.backend = sqlalchemy {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.connection = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.connection_debug = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.connection_parameters = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.connection_recycle_time = 3600 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.connection_trace = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.db_inc_retry_interval = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.db_max_retries = 20 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.db_max_retry_interval = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.db_retry_interval = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.max_overflow = 50 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.max_pool_size = 5 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.max_retries = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.pool_timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.retry_interval = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.slave_connection = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.sqlite_synchronous = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.synchronous_reader = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] database.use_db_reconnect = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_tracing.insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.connection_string = messaging:// {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.es_doc_type = notification {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.es_scroll_size = 10000 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.es_scroll_time = 2m {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.filter_error_trace = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.hmac_keys = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.sentinel_service_name = mymaster {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.socket_timeout = 0.1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.trace_requests = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler.trace_sqlalchemy = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler_jaeger.process_tags = {} {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] profiler_otlp.service_name_prefix = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.policy_default_rule = default {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.policy_file = policy.yaml {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.group = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.helper_command = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] privsep_osbrick.user = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.group = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.helper_command = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] cinder_sys_admin.user = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.auth_section = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.auth_type = password {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.cafile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.collect_timing = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.send_service_user_token = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.split_loggers = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.tls_ciphers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] service_user.tls_min_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.auth_section = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.auth_type = password {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.collect_timing = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.region_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.split_loggers = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.tls_ciphers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] glance.tls_min_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.backend_availability_zone = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.chap_password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.chap_username = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.disk_geometry = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.driver_client_cert = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.driver_data_namespace = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.driver_use_ssl = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.extra_capabilities = {} {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.filter_function = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.goodness_function = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.iscsi_target_flags = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.iser_helper = tgtadm {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.iser_ip_address = 192.168.122.54 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.iser_port = 3260 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_host = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_login = admin {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_mount_options = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_private_key = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_share_path = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.replication_device = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.report_discard_supported = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.target_helper = tgtadm {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.target_ip_address = 192.168.122.54 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.target_port = 3260 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.target_protocol = iscsi {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.trace_flags = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.use_chap_auth = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_backend_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_clear = zero {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_reports.file_event_handler = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack quobyte-client[87125]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_reports.log_dir = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.backend_host = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.chap_password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack quobyte-client[87125]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.chap_username = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.chiscsi_conf = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.disk_geometry = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.driver_client_cert = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.driver_use_ssl = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.extra_capabilities = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.filter_function = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.goodness_function = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.iser_helper = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.iser_ip_address = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.iser_port = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.iser_target_prefix = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_host = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_login = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_mount_options = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_password = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_private_key = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_share_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_ssh_port = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.num_shell_tries = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.nvmet_port_id = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.replication_device = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.report_discard_supported = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.reserved_percentage = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.scst_target_driver = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.storage_protocol = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.target_helper = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.target_ip_address = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.target_port = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.target_prefix = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.target_protocol = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.trace_flags = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.use_chap_auth = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_clear = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_clear_size = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] QuobyteHD.volumes_dir = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:34 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_notifications.driver = [] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] key_manager.fixed_key = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.barbican_api_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.barbican_endpoint = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.barbican_endpoint_type = public {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.barbican_region_name = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.cafile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.collect_timing = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.number_of_retries = 60 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.retry_delay = 1 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.send_service_user_token = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.split_loggers = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.tls_ciphers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.tls_min_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.verify_ssl = True {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican.verify_ssl_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.auth_section = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.auth_type = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.cafile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.certfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.collect_timing = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.insecure = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.keyfile = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.split_loggers = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.timeout = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.tls_ciphers = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] barbican_service_user.tls_min_version = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.approle_role_id = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.approle_secret_id = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.auth_method = approle {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.auth_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.kv_mountpoint = secret {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.kv_path = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.kv_version = 2 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.namespace = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.root_token_id = **** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.ssl_ca_crt_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.timeout = 60.0 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.token_file = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.token_role = None {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.use_ssl = False {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:57:34 devstack cinder-volume[86836]: DEBUG oslo_service.backend._eventlet.service [None req-afe87b14-8eb8-4d46-83b4-b6e8fa0b10f0 None None] ******************************************************************************** {{(pid=86836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:57:34 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.242s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.volume.driver [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.driver [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87124) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_db.sqlalchemy.engines [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writer thread running {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.db.api [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Building query based on filter {{(pid=87124) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87124) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.keymgr.migration [None req-303be978-f894-4595-bcce-c0593ccf621b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:57:34 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:34 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:34 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.254s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Driver initialization completed successfully. Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Initiating service 3 cleanup Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Service 3 cleanup completed. Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.service [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Creating RPC server for service cinder-volume {{(pid=87124) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG cinder.service [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87124) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:57:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:57:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:35 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:57:35 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:35 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a80a7080-8362-4e31-8380-76edf17a37f8 None None] Driver post RPC initialization completed successfully. Sep 28 14:57:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 6 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:57:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:57:44 devstack cinder-volume[86836]: DEBUG dbcounter [-] [86836] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86836) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:44 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Flow 'volume_create_manager' (7541d143-462d-49cd-a94a-c73ad801f28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3d1c15-cf23-4e07-8346-bb1ba4e837af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3d1c15-cf23-4e07-8346-bb1ba4e837af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-228224719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ea9bb2-133a-4437-88ac-643fe15220e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac48784761e47d390c7522a1c29f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:35Z,use_quota=True,user_id='50688f288b9a41d1a8e7817ad5e9cc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341688a6-32ef-431a-9e88-d0a54dae6e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341688a6-32ef-431a-9e88-d0a54dae6e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ec2334-d1f5-4ea8-bb97-fe1c4df31b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ec2334-d1f5-4ea8-bb97-fe1c4df31b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ea9bb2-133a-4437-88ac-643fe15220e2', 'volume_name': 'volume-d3ea9bb2-133a-4437-88ac-643fe15220e2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d55b04-85e3-4787-a5c6-2c0d4f951267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d55b04-85e3-4787-a5c6-2c0d4f951267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7efa7c3-5ac2-4e35-ae26-7137ea7dfff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:35 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Volume d3ea9bb2-133a-4437-88ac-643fe15220e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ea9bb2-133a-4437-88ac-643fe15220e2', 'volume_size': 1} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-228224719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ea9bb2-133a-4437-88ac-643fe15220e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac48784761e47d390c7522a1c29f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:35Z,use_quota=True,user_id='50688f288b9a41d1a8e7817ad5e9cc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Creating volume d3ea9bb2-133a-4437-88ac-643fe15220e2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:58:35 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 14:58:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:35 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 1073741824 Sep 28 14:58:35 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:36 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 1073741824" returned: 0 in 0.744s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:36 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 Sep 28 14:58:36 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:36 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2" returned: 0 in 0.399s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7efa7c3-5ac2-4e35-ae26-7137ea7dfff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ea9bb2-133a-4437-88ac-643fe15220e2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a53e69f-a12b-41d8-ad20-eadc72401500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:36 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Volume volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 (d3ea9bb2-133a-4437-88ac-643fe15220e2): created successfully Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a53e69f-a12b-41d8-ad20-eadc72401500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Flow 'volume_create_manager' (7541d143-462d-49cd-a94a-c73ad801f28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-defdeb74-0b09-4d2c-92d3-42f6edc30cbb tempest-TaggedAttachmentsTest-486449260 None] Created volume successfully. Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:37 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:58:37 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:37 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.330s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 6 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:58:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:58:46 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:46 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Flow 'volume_create_manager' (e7f93c0d-af0c-48de-bc39-26abdfa60439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222a5b42-7d37-4994-9659-3d311ba27a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222a5b42-7d37-4994-9659-3d311ba27a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2028879046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563fa47d-4c0f-43e7-be8f-e03dde06d6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c37057cabd541a98fce098205720881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:21Z,use_quota=True,user_id='052586afd64c48258d23d87e113b94ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27eca30-36c1-4598-85db-72a72c3c3085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27eca30-36c1-4598-85db-72a72c3c3085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6dfbab-b31a-4179-9344-a3373894d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6dfbab-b31a-4179-9344-a3373894d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563fa47d-4c0f-43e7-be8f-e03dde06d6db', 'volume_name': 'volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d71b816-af88-4747-a382-1feb4a0e3b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d71b816-af88-4747-a382-1feb4a0e3b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd726b4-dd8f-43f0-93a9-be2e33797a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:21 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Volume 563fa47d-4c0f-43e7-be8f-e03dde06d6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db', 'volume_size': 1} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2028879046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563fa47d-4c0f-43e7-be8f-e03dde06d6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c37057cabd541a98fce098205720881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:21Z,use_quota=True,user_id='052586afd64c48258d23d87e113b94ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Creating volume 563fa47d-4c0f-43e7-be8f-e03dde06d6db {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:21 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 14:59:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:21 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db 1073741824 Sep 28 14:59:21 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:22 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db 1073741824" returned: 0 in 1.186s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:22 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db Sep 28 14:59:22 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:23 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db" returned: 0 in 1.052s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd726b4-dd8f-43f0-93a9-be2e33797a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e986728-260c-4593-95a2-d02ecc6a6ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Volume volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db (563fa47d-4c0f-43e7-be8f-e03dde06d6db): created successfully Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e986728-260c-4593-95a2-d02ecc6a6ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Flow 'volume_create_manager' (e7f93c0d-af0c-48de-bc39-26abdfa60439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-22965e35-d222-4816-bf85-3bbf9e533af3 tempest-VolumesAdminNegativeTest-1414921418 None] Created volume successfully. Sep 28 14:59:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Acquiring lock "cinder-563fa47d-4c0f-43e7-be8f-e03dde06d6db-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "cinder-563fa47d-4c0f-43e7-be8f-e03dde06d6db-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Acquiring lock "cinder-quobyte-563fa47d-4c0f-43e7-be8f-e03dde06d6db" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "cinder-quobyte-563fa47d-4c0f-43e7-be8f-e03dde06d6db" acquired by "delete_volume" :: waited 0.056s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:27 devstack cinder-volume[87124]: INFO oslo.privsep.daemon [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2144ycoh/privsep.sock'] Sep 28 14:59:27 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2144ycoh/privsep.sock Sep 28 14:59:27 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Flow 'volume_create_manager' (70c3fbe5-30da-4272-93c5-84cba8ff6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3f5843-624c-4f2f-864d-7bd7117cf586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3f5843-624c-4f2f-864d-7bd7117cf586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1053603042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1074a27-f4ea-4c50-8d98-a5383988039f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc6e7e17c524643961b088717fb3251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:28Z,use_quota=True,user_id='a54e4ed1edc8431a9f87d8e1a7a03ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b85ce04-cb71-415e-ac95-fbf91680fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b85ce04-cb71-415e-ac95-fbf91680fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e32a553-a3b8-4458-8589-53cfcce63e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e32a553-a3b8-4458-8589-53cfcce63e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1074a27-f4ea-4c50-8d98-a5383988039f', 'volume_name': 'volume-e1074a27-f4ea-4c50-8d98-a5383988039f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d67bb1-5bfb-4b7c-b2ac-13f4d50cdf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d67bb1-5bfb-4b7c-b2ac-13f4d50cdf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9af5d9-2295-4cc8-9aec-0ae2a7414090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:28 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Volume e1074a27-f4ea-4c50-8d98-a5383988039f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1074a27-f4ea-4c50-8d98-a5383988039f', 'volume_size': 1} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1053603042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1074a27-f4ea-4c50-8d98-a5383988039f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc6e7e17c524643961b088717fb3251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:28Z,use_quota=True,user_id='a54e4ed1edc8431a9f87d8e1a7a03ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Creating volume e1074a27-f4ea-4c50-8d98-a5383988039f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:28 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 14:59:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:29 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f 1073741824 Sep 28 14:59:29 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 14:59:30 devstack cinder-volume[87124]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 14:59:30 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f 1073741824" returned: 0 in 1.928s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:31 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f Sep 28 14:59:31 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:31 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:31 devstack cinder-volume[87124]: INFO oslo.privsep.daemon [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Spawned new privsep daemon via rootwrap Sep 28 14:59:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Accepted privsep connection to /tmp/tmp2144ycoh/privsep.sock {{(pid=87124) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 14:59:31 devstack cinder-volume[87124]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 14:59:31 devstack cinder-volume[87124]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 14:59:31 devstack cinder-volume[87124]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 14:59:31 devstack cinder-volume[87124]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88382 Sep 28 14:59:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[29873edc-617d-4290-a00d-1b5fc6b5900e]: (2,) {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe22dc-8933-4ff5-90ac-a1859bd0dff5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:32 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db Sep 28 14:59:32 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:32 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f" returned: 0 in 1.185s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] <== create_volume: return (3367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.386s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9af5d9-2295-4cc8-9aec-0ae2a7414090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1074a27-f4ea-4c50-8d98-a5383988039f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41765a6-5cd7-4356-875d-3957b376b19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Volume volume-e1074a27-f4ea-4c50-8d98-a5383988039f (e1074a27-f4ea-4c50-8d98-a5383988039f): created successfully Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41765a6-5cd7-4356-875d-3957b376b19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Flow 'volume_create_manager' (70c3fbe5-30da-4272-93c5-84cba8ff6407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4bada3d8-80f1-436a-8018-f61507a35d07 tempest-ServerRescueNegativeTestJSON-789730170 None] Created volume successfully. Sep 28 14:59:33 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db" returned: 0 in 1.691s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:33 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db Sep 28 14:59:33 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:34 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-563fa47d-4c0f-43e7-be8f-e03dde06d6db" returned: 0 in 0.874s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "cinder-quobyte-563fa47d-4c0f-43e7-be8f-e03dde06d6db" released by "delete_volume" :: held 7.030s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:34 devstack cinder-volume[87124]: WARNING cinder.quota [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:59:34 devstack cinder-volume[87124]: WARNING cinder.quota [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Created reservations ['d9c63d13-1746-46ad-b0be-1c9636dd6516', 'fd0c9233-4fc6-468c-b73c-7295eb5a3987', '75d66fcf-d54f-481b-b85e-d3d1ce42cb38', '77aa2186-9336-4098-8567-d3557e2843dd'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:34 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:59:34 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:35 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.604s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:35 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Deleted volume successfully. Sep 28 14:59:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2ba1de1-0e44-4f84-bd06-7636834c0d42 tempest-VolumesAdminNegativeTest-1414921418 None] Lock "cinder-563fa47d-4c0f-43e7-be8f-e03dde06d6db-delete_volume" released by "delete_volume" :: held 8.643s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:37 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 14:59:37 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:38 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.795s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:38 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Acquiring lock "cinder-e1074a27-f4ea-4c50-8d98-a5383988039f-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "cinder-e1074a27-f4ea-4c50-8d98-a5383988039f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Acquiring lock "cinder-quobyte-e1074a27-f4ea-4c50-8d98-a5383988039f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "cinder-quobyte-e1074a27-f4ea-4c50-8d98-a5383988039f" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed25042-3a01-46db-9802-388e292501a6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:00 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f Sep 28 15:00:00 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:01 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f" returned: 0 in 0.553s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:01 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f Sep 28 15:00:01 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:01 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1074a27-f4ea-4c50-8d98-a5383988039f" returned: 0 in 0.553s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "cinder-quobyte-e1074a27-f4ea-4c50-8d98-a5383988039f" released by "delete_volume" :: held 1.177s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Created reservations ['027abddd-7120-4f2c-b362-f0f75c5b75da', 'ea149d60-5b1b-45ca-afa9-e6153afe86d9', '073a8ad2-b1ee-4990-8211-f57df92ece73', '51ef4626-a00e-4d82-89a4-276794b8c9f8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:01 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:00:01 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:02 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.440s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:02 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Deleted volume successfully. Sep 28 15:00:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2fd7e867-1b1f-468f-8fd2-51fb17a909f9 tempest-ServerRescueNegativeTestJSON-789730170 None] Lock "cinder-e1074a27-f4ea-4c50-8d98-a5383988039f-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:11 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:21 devstack cinder-volume[87124]: WARNING py.warnings [req-acf5513e-f722-439c-9bf2-f143fea68f51 req-1cb5dfb0-1c8f-4d44-916c-974e2c259a84 tempest-TaggedAttachmentsTest-486449260 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 15:00:21 devstack cinder-volume[87124]: .first() Sep 28 15:00:21 devstack cinder-volume[87124]: Sep 28 15:00:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-acf5513e-f722-439c-9bf2-f143fea68f51 req-1cb5dfb0-1c8f-4d44-916c-974e2c259a84 tempest-TaggedAttachmentsTest-486449260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-acf5513e-f722-439c-9bf2-f143fea68f51 req-1cb5dfb0-1c8f-4d44-916c-974e2c259a84 tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-acf5513e-f722-439c-9bf2-f143fea68f51 req-1cb5dfb0-1c8f-4d44-916c-974e2c259a84 tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-acf5513e-f722-439c-9bf2-f143fea68f51 req-1cb5dfb0-1c8f-4d44-916c-974e2c259a84 tempest-TaggedAttachmentsTest-486449260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-d3ea9bb2-133a-4437-88ac-643fe15220e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '803313fd-2c0c-4b38-86d2-2122d8bf70ec', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:00:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-acf5513e-f722-439c-9bf2-f143fea68f51 req-1cb5dfb0-1c8f-4d44-916c-974e2c259a84 tempest-TaggedAttachmentsTest-486449260 None] attachment_update completed successfully. Sep 28 15:00:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-af5e511d-8299-4a5e-85df-f3f838d1d1c2 req-bcc8bcfa-2554-4416-8df2-6b36289cea4c tempest-TaggedAttachmentsTest-486449260 None] Terminate volume connection completed successfully. Sep 28 15:00:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-af5e511d-8299-4a5e-85df-f3f838d1d1c2 req-bcc8bcfa-2554-4416-8df2-6b36289cea4c tempest-TaggedAttachmentsTest-486449260 None] Deleting attachment 803313fd-2c0c-4b38-86d2-2122d8bf70ec. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:37 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:00:37 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:37 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.511s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 8 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:00:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:00:38 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:38 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Flow 'volume_create_manager' (045c5493-80aa-4a5b-95e4-3a0f0aa080c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7c8a8e-4978-43f1-9687-2065a52be1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7c8a8e-4978-43f1-9687-2065a52be1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-924678218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21964f81-1f47-4e43-bb80-5012a1e808f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6af232630134ad79839de52756a127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:46Z,use_quota=True,user_id='c718eada2049436a8df8c0338f8f3f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab445100-594f-403a-a5f7-af4cada22662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab445100-594f-403a-a5f7-af4cada22662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82823436-b33a-4d29-b126-cbfe0425a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82823436-b33a-4d29-b126-cbfe0425a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21964f81-1f47-4e43-bb80-5012a1e808f8', 'volume_name': 'volume-21964f81-1f47-4e43-bb80-5012a1e808f8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a2bde0-eee3-4ed8-91fb-01592644c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a2bde0-eee3-4ed8-91fb-01592644c418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e59829f-2b23-43b0-96b5-d75514dd966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Volume 21964f81-1f47-4e43-bb80-5012a1e808f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21964f81-1f47-4e43-bb80-5012a1e808f8', 'volume_size': 1} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-924678218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21964f81-1f47-4e43-bb80-5012a1e808f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6af232630134ad79839de52756a127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:46Z,use_quota=True,user_id='c718eada2049436a8df8c0338f8f3f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Creating volume 21964f81-1f47-4e43-bb80-5012a1e808f8 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:46 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:46 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 1073741824 Sep 28 15:00:46 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:46 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 1073741824" returned: 0 in 0.675s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:47 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 Sep 28 15:00:47 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:47 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8" returned: 0 in 0.276s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e59829f-2b23-43b0-96b5-d75514dd966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21964f81-1f47-4e43-bb80-5012a1e808f8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65fd454-c1df-419a-998d-a43fd52a5096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Volume volume-21964f81-1f47-4e43-bb80-5012a1e808f8 (21964f81-1f47-4e43-bb80-5012a1e808f8): created successfully Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65fd454-c1df-419a-998d-a43fd52a5096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Flow 'volume_create_manager' (045c5493-80aa-4a5b-95e4-3a0f0aa080c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1116e396-0559-4d98-bc1e-ba7efb11dd0d tempest-ServerActionsTestOtherA-550705872 None] Created volume successfully. Sep 28 15:00:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Acquiring lock "cinder-d3ea9bb2-133a-4437-88ac-643fe15220e2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Lock "cinder-d3ea9bb2-133a-4437-88ac-643fe15220e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Acquiring lock "cinder-quobyte-d3ea9bb2-133a-4437-88ac-643fe15220e2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Lock "cinder-quobyte-d3ea9bb2-133a-4437-88ac-643fe15220e2" acquired by "delete_volume" :: waited 0.069s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc4237-e921-45c7-bf49-3c580edc4b64]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:50 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 Sep 28 15:00:50 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:50 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2" returned: 0 in 0.778s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:50 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2 Sep 28 15:00:50 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:51 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d3ea9bb2-133a-4437-88ac-643fe15220e2" returned: 0 in 0.700s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Lock "cinder-quobyte-d3ea9bb2-133a-4437-88ac-643fe15220e2" released by "delete_volume" :: held 1.590s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Created reservations ['6e330200-687e-4de1-98f7-2cc167a54e77', '987ef95b-0345-42f3-bb85-86a8db2021e1', '35b378ce-169b-4bd3-beb9-78791ac0deed', '5008f36d-7c13-4939-86cc-327b6e461ca2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:51 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:00:51 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:52 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.599s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:52 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Deleted volume successfully. Sep 28 15:00:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fc1c2fb-d38b-4ac1-a2a3-cb2699606835 tempest-TaggedAttachmentsTest-486449260 None] Lock "cinder-d3ea9bb2-133a-4437-88ac-643fe15220e2-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Flow 'volume_create_manager' (306e1271-e7eb-4644-b02f-a559bc3a1043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d472b20f-8844-4db2-b7b1-8d817597a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d472b20f-8844-4db2-b7b1-8d817597a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-623476097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e787f844-d2a5-4067-99d3-d484cd658414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08d87e1eea4730ac015f0b07c0fbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:58Z,use_quota=True,user_id='90e456d4c2274a978d28c01abd518aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939884a-7680-4f3a-a4b4-253adf8901e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939884a-7680-4f3a-a4b4-253adf8901e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3186a665-9374-4dd2-ade2-773da7005cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3186a665-9374-4dd2-ade2-773da7005cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e787f844-d2a5-4067-99d3-d484cd658414', 'volume_name': 'volume-e787f844-d2a5-4067-99d3-d484cd658414', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaed60c-a217-40c0-8be9-72511bc52322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaed60c-a217-40c0-8be9-72511bc52322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeae5859-fa1a-4a9b-9dd2-70371180e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:58 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Volume e787f844-d2a5-4067-99d3-d484cd658414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e787f844-d2a5-4067-99d3-d484cd658414', 'volume_size': 1} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-623476097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e787f844-d2a5-4067-99d3-d484cd658414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a08d87e1eea4730ac015f0b07c0fbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:58Z,use_quota=True,user_id='90e456d4c2274a978d28c01abd518aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Creating volume e787f844-d2a5-4067-99d3-d484cd658414 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:58 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:00:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:58 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 1073741824 Sep 28 15:00:58 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:59 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 1073741824" returned: 0 in 1.562s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:00 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 Sep 28 15:01:00 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:00 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414" returned: 0 in 0.595s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeae5859-fa1a-4a9b-9dd2-70371180e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e787f844-d2a5-4067-99d3-d484cd658414', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7da61f-b58e-4d41-a382-8cbceeb3efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:00 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Volume volume-e787f844-d2a5-4067-99d3-d484cd658414 (e787f844-d2a5-4067-99d3-d484cd658414): created successfully Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7da61f-b58e-4d41-a382-8cbceeb3efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Flow 'volume_create_manager' (306e1271-e7eb-4644-b02f-a559bc3a1043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6cb751d0-c524-42ee-8a2e-636d829c0af0 tempest-DeleteServersTestJSON-805573404 None] Created volume successfully. Sep 28 15:01:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-8872ff05-ceb6-4439-bacf-6b1ffad8e887 req-c68afd25-efde-4499-9804-d163a16d6f74 tempest-DeleteServersTestJSON-805573404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-8872ff05-ceb6-4439-bacf-6b1ffad8e887 req-c68afd25-efde-4499-9804-d163a16d6f74 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-8872ff05-ceb6-4439-bacf-6b1ffad8e887 req-c68afd25-efde-4499-9804-d163a16d6f74 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-8872ff05-ceb6-4439-bacf-6b1ffad8e887 req-c68afd25-efde-4499-9804-d163a16d6f74 tempest-DeleteServersTestJSON-805573404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-e787f844-d2a5-4067-99d3-d484cd658414', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '047d71c1-4e3b-4fa7-8c84-118e9d086f5d', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:01:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-8872ff05-ceb6-4439-bacf-6b1ffad8e887 req-c68afd25-efde-4499-9804-d163a16d6f74 tempest-DeleteServersTestJSON-805573404 None] attachment_update completed successfully. Sep 28 15:01:17 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=18,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:17 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=17,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-1a458baf-bdc2-4054-be66-1143f56f2f32 req-030cca65-b083-451a-8a8d-18e340d779ad tempest-DeleteServersTestJSON-805573404 None] Terminate volume connection completed successfully. Sep 28 15:01:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-1a458baf-bdc2-4054-be66-1143f56f2f32 req-030cca65-b083-451a-8a8d-18e340d779ad tempest-DeleteServersTestJSON-805573404 None] Deleting attachment 047d71c1-4e3b-4fa7-8c84-118e9d086f5d. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Acquiring lock "cinder-e787f844-d2a5-4067-99d3-d484cd658414-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Lock "cinder-e787f844-d2a5-4067-99d3-d484cd658414-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Acquiring lock "cinder-quobyte-e787f844-d2a5-4067-99d3-d484cd658414" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Lock "cinder-quobyte-e787f844-d2a5-4067-99d3-d484cd658414" acquired by "delete_volume" :: waited 0.057s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd4c4b6-d9a2-4b64-b620-a5631ae63b60]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:22 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 Sep 28 15:01:22 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:23 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414" returned: 0 in 1.234s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:23 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414 Sep 28 15:01:23 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:24 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e787f844-d2a5-4067-99d3-d484cd658414" returned: 0 in 0.775s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Lock "cinder-quobyte-e787f844-d2a5-4067-99d3-d484cd658414" released by "delete_volume" :: held 2.144s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Created reservations ['e1afdce0-a371-4665-a141-3aab2fcedecd', '11c411cb-95b2-4dd0-9c74-efa9777bf3b3', 'f9ebf7b0-ae25-4333-afae-5c71c183c431', 'dace0998-390c-4a04-9d1c-8e897f046e8a'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:24 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:01:24 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:25 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.344s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:25 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Deleted volume successfully. Sep 28 15:01:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07712185-079b-4861-a5ff-03a6370a68c7 tempest-DeleteServersTestJSON-805573404 None] Lock "cinder-e787f844-d2a5-4067-99d3-d484cd658414-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:34 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:35 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 8 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:01:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Flow 'volume_create_manager' (22fd3196-0825-4ebc-917c-571122e84032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7ea366-0772-4f89-84df-4ea5c481c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7ea366-0772-4f89-84df-4ea5c481c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-265770021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b41215-1714-43ff-9259-9a01bef072bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15675b3d284f4eb1a2239a98ea66b6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:42Z,use_quota=True,user_id='eb7497a18368458684e88c3bff62a6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effd69ac-a239-4e3d-a9a6-bd754f9ff59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effd69ac-a239-4e3d-a9a6-bd754f9ff59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f8b94a-3e33-4da7-a3e7-297aa2697609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f8b94a-3e33-4da7-a3e7-297aa2697609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b41215-1714-43ff-9259-9a01bef072bc', 'volume_name': 'volume-10b41215-1714-43ff-9259-9a01bef072bc', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b69155d-b3e6-4d95-be0c-bd81609aed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b69155d-b3e6-4d95-be0c-bd81609aed96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6372d1eb-e957-48be-ae2f-c2ac7c1d9135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Volume 10b41215-1714-43ff-9259-9a01bef072bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b41215-1714-43ff-9259-9a01bef072bc', 'volume_size': 1} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-265770021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b41215-1714-43ff-9259-9a01bef072bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15675b3d284f4eb1a2239a98ea66b6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:42Z,use_quota=True,user_id='eb7497a18368458684e88c3bff62a6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Creating volume 10b41215-1714-43ff-9259-9a01bef072bc {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:42 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:42 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc 1073741824 Sep 28 15:01:42 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:42 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc 1073741824" returned: 0 in 0.549s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:42 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc Sep 28 15:01:42 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:43 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc" returned: 0 in 0.460s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6372d1eb-e957-48be-ae2f-c2ac7c1d9135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b41215-1714-43ff-9259-9a01bef072bc', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c083117-c587-490c-b63b-8c8fe2400c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Volume volume-10b41215-1714-43ff-9259-9a01bef072bc (10b41215-1714-43ff-9259-9a01bef072bc): created successfully Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c083117-c587-490c-b63b-8c8fe2400c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Flow 'volume_create_manager' (22fd3196-0825-4ebc-917c-571122e84032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0575f9b1-f4c3-4aec-bb40-6a9105f33ab7 tempest-ServersNegativeTestJSON-1248216049 None] Created volume successfully. Sep 28 15:01:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-d8a21e98-6070-4a5a-80fd-37ff44d6a397 req-1e80e694-5309-4e6c-a456-1e9b9c1678c3 tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-d8a21e98-6070-4a5a-80fd-37ff44d6a397 req-1e80e694-5309-4e6c-a456-1e9b9c1678c3 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-d8a21e98-6070-4a5a-80fd-37ff44d6a397 req-1e80e694-5309-4e6c-a456-1e9b9c1678c3 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-d8a21e98-6070-4a5a-80fd-37ff44d6a397 req-1e80e694-5309-4e6c-a456-1e9b9c1678c3 tempest-ServerActionsTestOtherA-550705872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-21964f81-1f47-4e43-bb80-5012a1e808f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd5979ac-d0d6-4011-ad1b-fa5f7ef497b0', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:01:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-d8a21e98-6070-4a5a-80fd-37ff44d6a397 req-1e80e694-5309-4e6c-a456-1e9b9c1678c3 tempest-ServerActionsTestOtherA-550705872 None] attachment_update completed successfully. Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Flow 'volume_create_manager' (e721c257-2ef7-442f-8c86-d99a1341a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14f39bd-ce0a-48c3-b231-0a123b8743ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14f39bd-ce0a-48c3-b231-0a123b8743ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1074828285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2e038d-82a4-47b5-8f0f-2ba4b09db290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15675b3d284f4eb1a2239a98ea66b6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:49Z,use_quota=True,user_id='eb7497a18368458684e88c3bff62a6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efa25b6-414b-430b-8226-42daf12d98ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efa25b6-414b-430b-8226-42daf12d98ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c593d7b9-7a27-4fce-af44-be083c5f9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c593d7b9-7a27-4fce-af44-be083c5f9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2e038d-82a4-47b5-8f0f-2ba4b09db290', 'volume_name': 'volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebbd09f-d646-4a59-9de8-5a45f4437fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebbd09f-d646-4a59-9de8-5a45f4437fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127d41f5-d1cb-4bbf-989f-a772c204346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:49 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Volume 2d2e038d-82a4-47b5-8f0f-2ba4b09db290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290', 'volume_size': 1} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1074828285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2e038d-82a4-47b5-8f0f-2ba4b09db290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15675b3d284f4eb1a2239a98ea66b6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:49Z,use_quota=True,user_id='eb7497a18368458684e88c3bff62a6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Creating volume 2d2e038d-82a4-47b5-8f0f-2ba4b09db290 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:01:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:49 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 1073741824 Sep 28 15:01:49 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:50 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 1073741824" returned: 0 in 0.686s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:50 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 Sep 28 15:01:50 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:50 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290" returned: 0 in 0.475s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127d41f5-d1cb-4bbf-989f-a772c204346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba5f9fa-2c9c-432a-946c-13b2c6c33df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Volume volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 (2d2e038d-82a4-47b5-8f0f-2ba4b09db290): created successfully Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba5f9fa-2c9c-432a-946c-13b2c6c33df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Flow 'volume_create_manager' (e721c257-2ef7-442f-8c86-d99a1341a306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4b639e76-9810-464e-8924-4e5f201b99a6 tempest-ServersNegativeTestJSON-1248216049 None] Created volume successfully. Sep 28 15:01:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-119ad731-b510-4960-bec1-853346b67266 req-7f5f58f7-2523-4ae3-a7e0-67d24934ec78 tempest-ServerActionsTestOtherA-550705872 None] Terminate volume connection completed successfully. Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-119ad731-b510-4960-bec1-853346b67266 req-7f5f58f7-2523-4ae3-a7e0-67d24934ec78 tempest-ServerActionsTestOtherA-550705872 None] Deleting attachment bd5979ac-d0d6-4011-ad1b-fa5f7ef497b0. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "cinder-2d2e038d-82a4-47b5-8f0f-2ba4b09db290-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-2d2e038d-82a4-47b5-8f0f-2ba4b09db290-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "cinder-quobyte-2d2e038d-82a4-47b5-8f0f-2ba4b09db290" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-quobyte-2d2e038d-82a4-47b5-8f0f-2ba4b09db290" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e074782a-af81-4778-9e5a-2f07bdfc0c1f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:52 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 Sep 28 15:01:52 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:53 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290" returned: 0 in 0.776s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:53 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290 Sep 28 15:01:53 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:53 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2d2e038d-82a4-47b5-8f0f-2ba4b09db290" returned: 0 in 0.612s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-quobyte-2d2e038d-82a4-47b5-8f0f-2ba4b09db290" released by "delete_volume" :: held 1.515s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-119ad731-b510-4960-bec1-853346b67266 req-38ce9858-7445-4103-8bc2-7c9da627e6cb tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-119ad731-b510-4960-bec1-853346b67266 req-38ce9858-7445-4103-8bc2-7c9da627e6cb tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-119ad731-b510-4960-bec1-853346b67266 req-38ce9858-7445-4103-8bc2-7c9da627e6cb tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-119ad731-b510-4960-bec1-853346b67266 req-38ce9858-7445-4103-8bc2-7c9da627e6cb tempest-ServerActionsTestOtherA-550705872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-21964f81-1f47-4e43-bb80-5012a1e808f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53f78ec6-1834-4b72-8cbd-596646f45703', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Created reservations ['08227146-fd80-4fdf-a0dd-2a80e673adf3', '246333cf-12bb-49d2-8998-aefb2cc7aa42', '4f10a703-60b7-43df-a02d-0e51e6e769ff', 'f172535b-6fd3-430b-a13a-157afc11dded'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-119ad731-b510-4960-bec1-853346b67266 req-38ce9858-7445-4103-8bc2-7c9da627e6cb tempest-ServerActionsTestOtherA-550705872 None] attachment_update completed successfully. Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:54 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:01:54 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "cinder-10b41215-1714-43ff-9259-9a01bef072bc-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-10b41215-1714-43ff-9259-9a01bef072bc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "cinder-quobyte-10b41215-1714-43ff-9259-9a01bef072bc" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-quobyte-10b41215-1714-43ff-9259-9a01bef072bc" acquired by "delete_volume" :: waited 0.063s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a080ff45-f182-455f-bb9f-5f86c26b1b9d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:55 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.714s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Deleted volume successfully. Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0712225-65af-47ef-8862-1c7a00135ae4 tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-2d2e038d-82a4-47b5-8f0f-2ba4b09db290-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:55 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc Sep 28 15:01:55 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:55 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc" returned: 0 in 0.743s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:56 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc Sep 28 15:01:56 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:56 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-10b41215-1714-43ff-9259-9a01bef072bc" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-quobyte-10b41215-1714-43ff-9259-9a01bef072bc" released by "delete_volume" :: held 1.293s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Created reservations ['80493b53-f9a4-4e78-8e39-59a7cad1dc1d', '2dba8775-57b0-4dc8-8165-9c768a07ace1', 'd6ab643c-4a7b-41aa-9d8e-d44bcdc0fa0b', 'bde2b783-fd47-430d-8a45-b64a9142499e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:56 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:01:56 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:57 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.516s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Deleted volume successfully. Sep 28 15:01:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-daca6da7-5996-472f-9149-a35f74b492fd tempest-ServersNegativeTestJSON-1248216049 None] Lock "cinder-10b41215-1714-43ff-9259-9a01bef072bc-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:06 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=25,cinder:SELECT=27,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:07 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=30,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:30 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-8e24f0e9-c073-4ef5-ade0-91a738918c23 req-59265c9a-ce74-442c-86a5-9a6b18b11a7a tempest-ServerActionsTestOtherA-550705872 None] Terminate volume connection completed successfully. Sep 28 15:02:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-8e24f0e9-c073-4ef5-ade0-91a738918c23 req-59265c9a-ce74-442c-86a5-9a6b18b11a7a tempest-ServerActionsTestOtherA-550705872 None] Deleting attachment 53f78ec6-1834-4b72-8cbd-596646f45703. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:37 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:02:37 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:37 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.337s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 8 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:02:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Flow 'volume_create_manager' (c27d9fe1-99db-43e9-93b6-228372838bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469b91ad-01eb-4be4-b838-25b7ca33f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469b91ad-01eb-4be4-b838-25b7ca33f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-385348307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e0bb58-326b-4931-87d2-ee17ca0e06a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55012bf0b38545529eea28876568493b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:39Z,use_quota=True,user_id='292e32b52770402e8c5965480b0fa9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108b886f-80f7-4067-b259-9e06f47d346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108b886f-80f7-4067-b259-9e06f47d346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1931d528-ef3b-4629-99a0-5c9140ee3720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1931d528-ef3b-4629-99a0-5c9140ee3720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e0bb58-326b-4931-87d2-ee17ca0e06a1', 'volume_name': 'volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e26dc17-014b-4bd0-81ac-d2563df7993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e26dc17-014b-4bd0-81ac-d2563df7993c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3869a85c-01c1-4157-9836-c8fa95f8f4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Volume c5e0bb58-326b-4931-87d2-ee17ca0e06a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1', 'volume_size': 1} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-385348307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e0bb58-326b-4931-87d2-ee17ca0e06a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55012bf0b38545529eea28876568493b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:39Z,use_quota=True,user_id='292e32b52770402e8c5965480b0fa9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Creating volume c5e0bb58-326b-4931-87d2-ee17ca0e06a1 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:39 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:39 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 1073741824 Sep 28 15:02:39 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:39 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 1073741824" returned: 0 in 0.585s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:40 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 Sep 28 15:02:40 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:40 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1" returned: 0 in 0.427s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3869a85c-01c1-4157-9836-c8fa95f8f4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb5578f-b664-4172-bb6a-071b057e4453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Volume volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 (c5e0bb58-326b-4931-87d2-ee17ca0e06a1): created successfully Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb5578f-b664-4172-bb6a-071b057e4453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Flow 'volume_create_manager' (c27d9fe1-99db-43e9-93b6-228372838bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a25eb7ab-2592-44c0-b205-bee15a0a6b1c tempest-AttachVolumeNegativeTest-1483546106 None] Created volume successfully. Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-2e1676a5-59d8-411a-8f7e-74386feb6854 req-a761869a-1ba7-4a3a-a606-e7eb79a338f5 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-2e1676a5-59d8-411a-8f7e-74386feb6854 req-a761869a-1ba7-4a3a-a606-e7eb79a338f5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-2e1676a5-59d8-411a-8f7e-74386feb6854 req-a761869a-1ba7-4a3a-a606-e7eb79a338f5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-2e1676a5-59d8-411a-8f7e-74386feb6854 req-a761869a-1ba7-4a3a-a606-e7eb79a338f5 tempest-AttachVolumeNegativeTest-1483546106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82cb3843-6043-446c-97f8-a9e151087c04', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:02:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-2e1676a5-59d8-411a-8f7e-74386feb6854 req-a761869a-1ba7-4a3a-a606-e7eb79a338f5 tempest-AttachVolumeNegativeTest-1483546106 None] attachment_update completed successfully. Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Flow 'volume_create_manager' (dd81e5de-7fb2-4974-9a95-0972c1eee3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5c9bf5-eed0-434f-aef3-e7669a8938f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5c9bf5-eed0-434f-aef3-e7669a8938f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1735885856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589533c3-d8d0-491e-b79d-05a097c849eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6af232630134ad79839de52756a127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:44Z,use_quota=True,user_id='c718eada2049436a8df8c0338f8f3f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d965275-e47c-4280-b596-a401ff11437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d965275-e47c-4280-b596-a401ff11437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a382f0-3f1d-4dec-bef3-243294e0f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:02:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a382f0-3f1d-4dec-bef3-243294e0f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '589533c3-d8d0-491e-b79d-05a097c849eb', 'volume_name': 'volume-589533c3-d8d0-491e-b79d-05a097c849eb', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ce36cd-1b32-4bbe-a2a2-c3b861412429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ce36cd-1b32-4bbe-a2a2-c3b861412429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a60a83a-765f-45a4-8afa-4c35f237c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:44 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Volume 589533c3-d8d0-491e-b79d-05a097c849eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-589533c3-d8d0-491e-b79d-05a097c849eb', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:02:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Trying to clone 589533c3-d8d0-491e-b79d-05a097c849eb from image c58ceb91-c951-49e6-a030-d9ed772c37aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:02:44 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:02:44 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb2fb6-2db3-43ba-af04-f51a155f9319]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD Sep 28 15:02:45 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:45 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD" returned: 0 in 0.580s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa is fetched for user c718eada2049436a8df8c0338f8f3f45. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[57be6554-209c-44f2-944a-e33b9448686d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Flow 'volume_create_manager' (d074d0fa-393b-4b58-a5d4-426a7a922cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2af97a8-f194-4d82-a42c-b0a5ee3efd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2af97a8-f194-4d82-a42c-b0a5ee3efd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1639071337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7aa9356-b787-4090-8d0a-8170f44a00d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c6493587df4334965c1b1da5a204ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:46Z,use_quota=True,user_id='dde16b77133743dd99ce8a017eab47d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c20ea9a-4266-444d-85bf-0c86a42c4a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c20ea9a-4266-444d-85bf-0c86a42c4a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e4d584-c7d7-4b66-85cc-359fb3d4aa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e4d584-c7d7-4b66-85cc-359fb3d4aa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7aa9356-b787-4090-8d0a-8170f44a00d0', 'volume_name': 'volume-a7aa9356-b787-4090-8d0a-8170f44a00d0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397b66bd-9960-4693-a13a-85289e30b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397b66bd-9960-4693-a13a-85289e30b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8bb6d7-c8c1-4d58-ab68-4f42a9d3ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Volume a7aa9356-b787-4090-8d0a-8170f44a00d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7aa9356-b787-4090-8d0a-8170f44a00d0', 'volume_size': 1} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1639071337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7aa9356-b787-4090-8d0a-8170f44a00d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c6493587df4334965c1b1da5a204ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:46Z,use_quota=True,user_id='dde16b77133743dd99ce8a017eab47d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Creating volume a7aa9356-b787-4090-8d0a-8170f44a00d0 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:45 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:02:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD Sep 28 15:02:45 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:45 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 1073741824 Sep 28 15:02:45 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:46 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:46 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 1073741824" returned: 0 in 0.646s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:46 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 Sep 28 15:02:46 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0" returned: 0 in 0.442s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1735885856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589533c3-d8d0-491e-b79d-05a097c849eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6af232630134ad79839de52756a127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:44Z,use_quota=True,user_id='c718eada2049436a8df8c0338f8f3f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Creating volume 589533c3-d8d0-491e-b79d-05a097c849eb {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:47 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8bb6d7-c8c1-4d58-ab68-4f42a9d3ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7aa9356-b787-4090-8d0a-8170f44a00d0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:47 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb 1073741824 Sep 28 15:02:47 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7a4c29-35ea-4348-a560-7591868140e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Volume volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 (a7aa9356-b787-4090-8d0a-8170f44a00d0): created successfully Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7a4c29-35ea-4348-a560-7591868140e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Flow 'volume_create_manager' (d074d0fa-393b-4b58-a5d4-426a7a922cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9fbaa102-fe65-4b83-9775-458b6825cc52 tempest-AttachVolumeTestJSON-770634496 None] Created volume successfully. Sep 28 15:02:48 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb 1073741824" returned: 0 in 1.029s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb Sep 28 15:02:48 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb" returned: 0 in 0.596s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:48 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Attempting download of c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 589533c3-d8d0-491e-b79d-05a097c849eb. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b886291-f83c-4eca-b305-a5386fb3ce83]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:49 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr Sep 28 15:02:49 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-99c6ca48-e3ec-425b-8a2f-a9e6fe706cb2 req-5c0a2754-30e2-4a20-8ae2-eea54b2ec00e tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-99c6ca48-e3ec-425b-8a2f-a9e6fe706cb2 req-5c0a2754-30e2-4a20-8ae2-eea54b2ec00e tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-99c6ca48-e3ec-425b-8a2f-a9e6fe706cb2 req-5c0a2754-30e2-4a20-8ae2-eea54b2ec00e tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-99c6ca48-e3ec-425b-8a2f-a9e6fe706cb2 req-5c0a2754-30e2-4a20-8ae2-eea54b2ec00e tempest-AttachVolumeTestJSON-770634496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-a7aa9356-b787-4090-8d0a-8170f44a00d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '314a63f8-368f-4663-837f-a2a3f2d192e1', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:02:49 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr" returned: 0 in 0.724s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-99c6ca48-e3ec-425b-8a2f-a9e6fe706cb2 req-5c0a2754-30e2-4a20-8ae2-eea54b2ec00e tempest-AttachVolumeTestJSON-770634496 None] attachment_update completed successfully. Sep 28 15:02:50 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr Sep 28 15:02:50 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:50 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr" returned: 1 in 0.682s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_e8i_evhr' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:02:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2744d0c4-7242-482d-98a7-52b70c31a29a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:50 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD Sep 28 15:02:50 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:51 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] c58ceb91-c951-49e6-a030-d9ed772c37aa was qcow2, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:02:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:51 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb Sep 28 15:02:51 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:54 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb" returned: 0 in 3.787s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:54 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_wu_da4fjdevstack@QuobyteHD, size 112.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:02:54 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Converted 112.00 MB image at 29.56 MB/s Sep 28 15:02:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:54 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb 1G Sep 28 15:02:54 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:55 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb 1G" returned: 0 in 0.893s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:55 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Downloaded image c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 589533c3-d8d0-491e-b79d-05a097c849eb successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:02:55 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa for user c718eada2049436a8df8c0338f8f3f45 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:02:55 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Marking volume 589533c3-d8d0-491e-b79d-05a097c849eb as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:02:55 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Copying metadata from image c58ceb91-c951-49e6-a030-d9ed772c37aa to 589533c3-d8d0-491e-b79d-05a097c849eb. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:02:55 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Creating volume glance metadata for volume 589533c3-d8d0-491e-b79d-05a097c849eb backed by image c58ceb91-c951-49e6-a030-d9ed772c37aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:02:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a60a83a-765f-45a4-8afa-4c35f237c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589533c3-d8d0-491e-b79d-05a097c849eb', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ced106-bfaa-4a99-96b1-f722ede0cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:56 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Volume volume-589533c3-d8d0-491e-b79d-05a097c849eb (589533c3-d8d0-491e-b79d-05a097c849eb): created successfully Sep 28 15:02:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ced106-bfaa-4a99-96b1-f722ede0cee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Flow 'volume_create_manager' (dd81e5de-7fb2-4974-9a95-0972c1eee3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a3910dda-921b-4fcc-a548-8fde072a0103 tempest-ServerActionsTestOtherA-550705872 None] Created volume successfully. Sep 28 15:03:06 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=25,cinder:UPDATE=14,cinder:INSERT=9 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:06 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=13,cinder:DELETE=3 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-c352f0dd-2b13-4052-a63b-389ea3ffb935 req-9ecfa4a5-a94f-4bd5-9e58-b63e16d0518a tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-c352f0dd-2b13-4052-a63b-389ea3ffb935 req-9ecfa4a5-a94f-4bd5-9e58-b63e16d0518a tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-c352f0dd-2b13-4052-a63b-389ea3ffb935 req-9ecfa4a5-a94f-4bd5-9e58-b63e16d0518a tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-c352f0dd-2b13-4052-a63b-389ea3ffb935 req-9ecfa4a5-a94f-4bd5-9e58-b63e16d0518a tempest-ServerActionsTestOtherA-550705872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-589533c3-d8d0-491e-b79d-05a097c849eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35847cdc-ea03-4be8-a0b9-60f526c8673f', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-c352f0dd-2b13-4052-a63b-389ea3ffb935 req-9ecfa4a5-a94f-4bd5-9e58-b63e16d0518a tempest-ServerActionsTestOtherA-550705872 None] attachment_update completed successfully. Sep 28 15:03:17 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:17 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Flow 'volume_create_manager' (cd10f7b1-a58b-4d39-87cb-6cae9853ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd07371-590c-4325-8825-42ddf47097c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd07371-590c-4325-8825-42ddf47097c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1419918085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdde0322-b93c-4b06-8011-2184a7d1444f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abefca3d7c8c41f19965b67c52b7f261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:24Z,use_quota=True,user_id='0b61892a16ed442da62ca9cec56d13a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164dcf9a-b4e1-4af7-a36a-f1eb40c0ddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164dcf9a-b4e1-4af7-a36a-f1eb40c0ddd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d464303c-df79-4532-afc1-b5bcf39c3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d464303c-df79-4532-afc1-b5bcf39c3626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdde0322-b93c-4b06-8011-2184a7d1444f', 'volume_name': 'volume-fdde0322-b93c-4b06-8011-2184a7d1444f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ce905b-4e4d-4325-bc32-0f2d6d95bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ce905b-4e4d-4325-bc32-0f2d6d95bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f439e4-fd82-42b7-9ee3-5b5e197ca89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Volume fdde0322-b93c-4b06-8011-2184a7d1444f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdde0322-b93c-4b06-8011-2184a7d1444f', 'volume_size': 1} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1419918085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdde0322-b93c-4b06-8011-2184a7d1444f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abefca3d7c8c41f19965b67c52b7f261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:24Z,use_quota=True,user_id='0b61892a16ed442da62ca9cec56d13a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Creating volume fdde0322-b93c-4b06-8011-2184a7d1444f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:24 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:03:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:24 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f 1073741824 Sep 28 15:03:24 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:25 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f 1073741824" returned: 0 in 1.002s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:25 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f Sep 28 15:03:25 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:25 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f" returned: 0 in 0.557s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f439e4-fd82-42b7-9ee3-5b5e197ca89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdde0322-b93c-4b06-8011-2184a7d1444f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a53d33c-689b-4354-b546-be58d60da6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Volume volume-fdde0322-b93c-4b06-8011-2184a7d1444f (fdde0322-b93c-4b06-8011-2184a7d1444f): created successfully Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a53d33c-689b-4354-b546-be58d60da6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Flow 'volume_create_manager' (cd10f7b1-a58b-4d39-87cb-6cae9853ec56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a1ed9a9f-2df1-4340-800a-f658eae44963 tempest-AttachVolumeShelveTestJSON-2079411440 None] Created volume successfully. Sep 28 15:03:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-cdb10d2d-80be-459a-b61e-2c163614db46 tempest-ServerActionsTestOtherA-550705872 None] Terminate volume connection completed successfully. Sep 28 15:03:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-cdb10d2d-80be-459a-b61e-2c163614db46 tempest-ServerActionsTestOtherA-550705872 None] Deleting attachment 35847cdc-ea03-4be8-a0b9-60f526c8673f. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-233b1126-85cd-4bc6-bda0-374f4a54b0da tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-233b1126-85cd-4bc6-bda0-374f4a54b0da tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-233b1126-85cd-4bc6-bda0-374f4a54b0da tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-233b1126-85cd-4bc6-bda0-374f4a54b0da tempest-ServerActionsTestOtherA-550705872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-589533c3-d8d0-491e-b79d-05a097c849eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9881db0e-98ab-450e-9624-104f58ce8858', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-03f52b2e-d8e1-49d9-842e-beb85157e00a req-233b1126-85cd-4bc6-bda0-374f4a54b0da tempest-ServerActionsTestOtherA-550705872 None] attachment_update completed successfully. Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:37 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:03:37 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:38 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.832s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:38 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:38 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:03:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:03:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-d6b39a21-d4f6-4996-8f76-49828327c281 req-8aca957e-4c4e-43a8-82ad-74bbe34975b9 tempest-AttachVolumeShelveTestJSON-2079411440 None] No connector for attachment 1a7fb2de-248f-4ea0-ad0b-c018415d41d3; skipping storage backend terminate_connection call. {{(pid=87124) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 15:03:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-d6b39a21-d4f6-4996-8f76-49828327c281 req-8aca957e-4c4e-43a8-82ad-74bbe34975b9 tempest-AttachVolumeShelveTestJSON-2079411440 None] Deleting attachment 1a7fb2de-248f-4ea0-ad0b-c018415d41d3. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-6579a144-c57b-4eb4-936e-f4e997961fd1 req-d6721c67-ba53-47bb-8f8e-b24e89a5e724 tempest-AttachVolumeTestJSON-770634496 None] Terminate volume connection completed successfully. Sep 28 15:03:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-6579a144-c57b-4eb4-936e-f4e997961fd1 req-d6721c67-ba53-47bb-8f8e-b24e89a5e724 tempest-AttachVolumeTestJSON-770634496 None] Deleting attachment 314a63f8-368f-4663-837f-a2a3f2d192e1. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:50 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:53 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:59 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-26b1cdb9-d866-43f7-9136-e4c1336705a9 req-a3092837-e429-4692-b9c6-a741126d82c2 tempest-AttachVolumeNegativeTest-1483546106 None] Terminate volume connection completed successfully. Sep 28 15:03:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-26b1cdb9-d866-43f7-9136-e4c1336705a9 req-a3092837-e429-4692-b9c6-a741126d82c2 tempest-AttachVolumeNegativeTest-1483546106 None] Deleting attachment 82cb3843-6043-446c-97f8-a9e151087c04. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:09 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-f070d2b7-743e-4ad0-8459-9d14b9877baa tempest-ServerActionsTestOtherA-550705872 None] Terminate volume connection completed successfully. Sep 28 15:04:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-f070d2b7-743e-4ad0-8459-9d14b9877baa tempest-ServerActionsTestOtherA-550705872 None] Deleting attachment 9881db0e-98ab-450e-9624-104f58ce8858. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "cinder-589533c3-d8d0-491e-b79d-05a097c849eb-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-589533c3-d8d0-491e-b79d-05a097c849eb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "cinder-quobyte-589533c3-d8d0-491e-b79d-05a097c849eb" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-quobyte-589533c3-d8d0-491e-b79d-05a097c849eb" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df46b8-e7e2-4efe-9176-169ba8030df0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:24 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb Sep 28 15:04:24 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:24 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb" returned: 0 in 0.852s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:24 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb Sep 28 15:04:24 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "cinder-21964f81-1f47-4e43-bb80-5012a1e808f8-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-21964f81-1f47-4e43-bb80-5012a1e808f8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "cinder-quobyte-21964f81-1f47-4e43-bb80-5012a1e808f8" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-quobyte-21964f81-1f47-4e43-bb80-5012a1e808f8" acquired by "delete_volume" :: waited 0.061s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd91a0-cc2b-4bd6-98db-54f8753b3e5e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:25 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 Sep 28 15:04:25 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:25 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-589533c3-d8d0-491e-b79d-05a097c849eb" returned: 0 in 0.473s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-quobyte-589533c3-d8d0-491e-b79d-05a097c849eb" released by "delete_volume" :: held 1.413s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.quota [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Created reservations ['e1f614d6-e6c1-41b3-ad67-4505725a8406', '57d16367-86a3-4f9b-b54d-7c0f668a93ba', '0b53a1bd-6e4f-4251-ba8b-2b8d5b59c019', '61bda662-3e0b-4fa5-b1c0-096957d52607'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:25 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:04:25 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:25 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8" returned: 0 in 0.593s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:25 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8 Sep 28 15:04:25 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:25 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.340s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.manager [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Deleted volume successfully. Sep 28 15:04:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-30874bcc-8918-4a1e-91b0-2552b73b6259 req-93be8b96-2242-4bf1-b9be-75912f63cb09 tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-589533c3-d8d0-491e-b79d-05a097c849eb-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:26 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-21964f81-1f47-4e43-bb80-5012a1e808f8" returned: 0 in 0.316s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-quobyte-21964f81-1f47-4e43-bb80-5012a1e808f8" released by "delete_volume" :: held 0.964s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Created reservations ['1e64ee6d-a81a-46f0-825e-07eeeda7930e', 'a79fade1-fda8-4534-be01-9b5a307b8eef', 'd76bab65-2530-4355-811a-e06a1e0b70da', '1ee967eb-0776-4625-8665-0568bdd51103'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:26 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:04:26 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.353s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Deleted volume successfully. Sep 28 15:04:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9dbbd290-fac5-4c29-8a01-6f25872a534b tempest-ServerActionsTestOtherA-550705872 None] Lock "cinder-21964f81-1f47-4e43-bb80-5012a1e808f8-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Acquiring lock "cinder-fdde0322-b93c-4b06-8011-2184a7d1444f-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "cinder-fdde0322-b93c-4b06-8011-2184a7d1444f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Acquiring lock "cinder-quobyte-fdde0322-b93c-4b06-8011-2184a7d1444f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "cinder-quobyte-fdde0322-b93c-4b06-8011-2184a7d1444f" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:33 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a6b0b-d3cf-47f6-aad5-ec680829fd81]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:33 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f Sep 28 15:04:33 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:34 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f" returned: 0 in 0.864s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:34 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f Sep 28 15:04:34 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:34 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdde0322-b93c-4b06-8011-2184a7d1444f" returned: 0 in 0.437s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "cinder-quobyte-fdde0322-b93c-4b06-8011-2184a7d1444f" released by "delete_volume" :: held 1.414s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:34 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Created reservations ['eee95fb9-484c-448e-b9c4-9f8ecfc33abf', 'e6404c86-7ee9-4219-a087-cfb0df98d357', 'b46059d6-ba95-4274-b798-0e097a21431d', '490f98b8-a081-4a0f-ac0e-e8ddbcd0776e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:35 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:04:35 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:35 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.358s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Deleted volume successfully. Sep 28 15:04:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-219b3099-25b0-4d7d-bf2d-414cca82f3b3 tempest-AttachVolumeShelveTestJSON-2079411440 None] Lock "cinder-fdde0322-b93c-4b06-8011-2184a7d1444f-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:37 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:04:37 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:37 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.433s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:04:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:04:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=24 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Flow 'volume_create_manager' (d51e92ff-8181-45b9-83a0-1d701685cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b15b1-b525-45fa-a16b-e03008a5d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b15b1-b525-45fa-a16b-e03008a5d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1753804826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a071bef-441b-49c4-a52a-1a5537ef94d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55012bf0b38545529eea28876568493b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:46Z,use_quota=True,user_id='292e32b52770402e8c5965480b0fa9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e404a4f-a627-4a1e-b3dc-8d0b44f35704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e404a4f-a627-4a1e-b3dc-8d0b44f35704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ac96dc-5ad6-4a75-abd5-65a8d194f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ac96dc-5ad6-4a75-abd5-65a8d194f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a071bef-441b-49c4-a52a-1a5537ef94d2', 'volume_name': 'volume-9a071bef-441b-49c4-a52a-1a5537ef94d2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d63d56-7a04-4222-811d-4589cd20a0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d63d56-7a04-4222-811d-4589cd20a0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17e5b90-d414-4d9b-91cd-3e194b126fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Volume 9a071bef-441b-49c4-a52a-1a5537ef94d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a071bef-441b-49c4-a52a-1a5537ef94d2', 'volume_size': 1} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1753804826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a071bef-441b-49c4-a52a-1a5537ef94d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55012bf0b38545529eea28876568493b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:46Z,use_quota=True,user_id='292e32b52770402e8c5965480b0fa9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Creating volume 9a071bef-441b-49c4-a52a-1a5537ef94d2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:46 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:04:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:46 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 1073741824 Sep 28 15:04:46 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:47 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 1073741824" returned: 0 in 0.659s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:47 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 Sep 28 15:04:47 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:47 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2" returned: 0 in 0.364s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17e5b90-d414-4d9b-91cd-3e194b126fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a071bef-441b-49c4-a52a-1a5537ef94d2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50e53c4-2f39-4b71-a241-a9e90ab4622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Volume volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 (9a071bef-441b-49c4-a52a-1a5537ef94d2): created successfully Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50e53c4-2f39-4b71-a241-a9e90ab4622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Flow 'volume_create_manager' (d51e92ff-8181-45b9-83a0-1d701685cfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-df9aec2f-b622-43e8-a58b-991e6f34ce9e tempest-AttachVolumeNegativeTest-1483546106 None] Created volume successfully. Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Flow 'volume_create_manager' (6a54f32b-bb60-4e40-8001-8c390a135d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb751fb-cb3f-42fa-bb7d-ad0555d120c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb751fb-cb3f-42fa-bb7d-ad0555d120c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1404032635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3287cad9-c407-4939-bbfd-17582e284889,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01fcd07eda8f41b7a1e4fbdce550aa53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:49Z,use_quota=True,user_id='ad4b8df00947475f8357c4891a20d404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb056cab-13ba-43f9-b4fa-515f7a222657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb056cab-13ba-43f9-b4fa-515f7a222657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00764b1-b0f5-487f-933c-5af3c6a98896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00764b1-b0f5-487f-933c-5af3c6a98896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3287cad9-c407-4939-bbfd-17582e284889', 'volume_name': 'volume-3287cad9-c407-4939-bbfd-17582e284889', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90612d9d-31a9-40f2-b02d-1e96d48bc0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90612d9d-31a9-40f2-b02d-1e96d48bc0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624394f8-af75-4a22-aa2d-eb2a52b1684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:49 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Volume 3287cad9-c407-4939-bbfd-17582e284889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3287cad9-c407-4939-bbfd-17582e284889', 'volume_size': 1} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1404032635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3287cad9-c407-4939-bbfd-17582e284889,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01fcd07eda8f41b7a1e4fbdce550aa53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:49Z,use_quota=True,user_id='ad4b8df00947475f8357c4891a20d404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Creating volume 3287cad9-c407-4939-bbfd-17582e284889 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:49 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 1073741824 Sep 28 15:04:49 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-c60ec6af-6564-4e6c-84fb-f5aeb88e6e86 req-61e12779-5d21-4fc7-a4ac-1e69ee1895ca tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:49 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 1073741824" returned: 0 in 0.719s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:50 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 Sep 28 15:04:50 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:50 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889" returned: 0 in 0.347s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-c60ec6af-6564-4e6c-84fb-f5aeb88e6e86 req-61e12779-5d21-4fc7-a4ac-1e69ee1895ca tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.777s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624394f8-af75-4a22-aa2d-eb2a52b1684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3287cad9-c407-4939-bbfd-17582e284889', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0c7518-ec9a-4ca3-98c9-e5e5782ab079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-c60ec6af-6564-4e6c-84fb-f5aeb88e6e86 req-61e12779-5d21-4fc7-a4ac-1e69ee1895ca tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-df08f378-356a-439d-a6c1-060f1464657f tempest-BackendsCapabilitiesAdminTestsJSON-1181992320 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87124) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:04:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Volume volume-3287cad9-c407-4939-bbfd-17582e284889 (3287cad9-c407-4939-bbfd-17582e284889): created successfully Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0c7518-ec9a-4ca3-98c9-e5e5782ab079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Flow 'volume_create_manager' (6a54f32b-bb60-4e40-8001-8c390a135d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-88fe8824-3b22-4c1e-8a33-0b57638328ee tempest-BackendsCapabilitiesAdminTestsJSON-1181992320 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87124) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:04:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-cfabf79b-7c2b-4362-a506-52b3b58c167f req-b2d9e978-c000-41c5-a28f-94ed69e9c814 tempest-VolumesGetTestJSON-1229485433 None] Created volume successfully. Sep 28 15:04:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-c60ec6af-6564-4e6c-84fb-f5aeb88e6e86 req-61e12779-5d21-4fc7-a4ac-1e69ee1895ca tempest-AttachVolumeNegativeTest-1483546106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-9a071bef-441b-49c4-a52a-1a5537ef94d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c570c9f4-8248-4043-acdf-68f8a40b9a1d', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-c60ec6af-6564-4e6c-84fb-f5aeb88e6e86 req-61e12779-5d21-4fc7-a4ac-1e69ee1895ca tempest-AttachVolumeNegativeTest-1483546106 None] attachment_update completed successfully. Sep 28 15:04:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Acquiring lock "cinder-3287cad9-c407-4939-bbfd-17582e284889-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Lock "cinder-3287cad9-c407-4939-bbfd-17582e284889-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Acquiring lock "cinder-quobyte-3287cad9-c407-4939-bbfd-17582e284889" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Lock "cinder-quobyte-3287cad9-c407-4939-bbfd-17582e284889" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a41b9-829d-4d0c-a6e1-e4c0f53f6b24]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:52 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 Sep 28 15:04:52 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889" returned: 0 in 0.529s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889 Sep 28 15:04:53 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3287cad9-c407-4939-bbfd-17582e284889" returned: 0 in 0.525s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Lock "cinder-quobyte-3287cad9-c407-4939-bbfd-17582e284889" released by "delete_volume" :: held 1.139s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG cinder.quota [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Created reservations ['d86c30da-1e05-4a12-bcd2-14dc21c8be00', '0e20c8cf-a46d-4d28-a4d1-2f3017456e86', 'a541ea18-e7ef-4c37-ad58-8c222d16537b', 'a6269732-9da0-4eb4-9554-fc5f4d3ff2cb'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:04:53 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:54 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.342s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:54 devstack cinder-volume[87124]: DEBUG cinder.manager [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Deleted volume successfully. Sep 28 15:04:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-639cd929-41e4-48c0-923f-803f0b9c4649 req-10d00685-d7c8-4b73-9665-84ec90188b2d tempest-VolumesGetTestJSON-1229485433 None] Lock "cinder-3287cad9-c407-4939-bbfd-17582e284889-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-81cffcbd-a27d-48b1-aa1d-1e72adbbf328 req-3f155e41-7c07-474e-a4c1-1024b999534e tempest-AttachVolumeNegativeTest-1483546106 None] Terminate volume connection completed successfully. Sep 28 15:04:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-81cffcbd-a27d-48b1-aa1d-1e72adbbf328 req-3f155e41-7c07-474e-a4c1-1024b999534e tempest-AttachVolumeNegativeTest-1483546106 None] Deleting attachment c570c9f4-8248-4043-acdf-68f8a40b9a1d. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-49b453c9-05f0-4ae1-9a2f-2302c081b4c9 tempest-GroupsTest-1305028637 None] Group tempest-Group1-1199013578: creating Sep 28 15:05:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-49b453c9-05f0-4ae1-9a2f-2302c081b4c9 tempest-GroupsTest-1305028637 None] Group tempest-Group1-1199013578: created successfully Sep 28 15:05:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-49b453c9-05f0-4ae1-9a2f-2302c081b4c9 tempest-GroupsTest-1305028637 None] Create group completed successfully. Sep 28 15:05:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-22a1858e-55b5-4e23-b0f1-1a1e4707c0f5 tempest-GroupsTest-1305028637 None] Group tempest-Group2-262345966: creating Sep 28 15:05:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-22a1858e-55b5-4e23-b0f1-1a1e4707c0f5 tempest-GroupsTest-1305028637 None] Group tempest-Group2-262345966: created successfully Sep 28 15:05:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-22a1858e-55b5-4e23-b0f1-1a1e4707c0f5 tempest-GroupsTest-1305028637 None] Create group completed successfully. Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Flow 'volume_create_manager' (c11a34c9-5c4f-4825-a017-fa26b9665e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f67b5d4-6b5b-4836-af8b-8379797c6212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f67b5d4-6b5b-4836-af8b-8379797c6212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77419323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4380ee92-e07b-46be-b045-f4f852a70185,host='devstack@QuobyteHD#QuobyteHD',id=4b0e4ac9-e420-4b4d-91bb-038036e94088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972c7cdf28d64e22ba56b47af7ddc8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:07Z,use_quota=True,user_id='b34c4b52b4de440fafa678948330fa85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46628b11-9fe9-4c32-b317-85a2748f5588),volume_type_id=46628b11-9fe9-4c32-b317-85a2748f5588)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63198475-ad0c-4b4c-aa92-35b4a24dce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63198475-ad0c-4b4c-aa92-35b4a24dce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbf1e5f-c2cf-402a-a652-4e6123b30af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbf1e5f-c2cf-402a-a652-4e6123b30af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0e4ac9-e420-4b4d-91bb-038036e94088', 'volume_name': 'volume-4b0e4ac9-e420-4b4d-91bb-038036e94088', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d210ee3e-a094-4a7d-bbf7-0f0ca65c89ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d210ee3e-a094-4a7d-bbf7-0f0ca65c89ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ff8c1d-b05f-4da4-bd40-27656296fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Volume 4b0e4ac9-e420-4b4d-91bb-038036e94088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0e4ac9-e420-4b4d-91bb-038036e94088', 'volume_size': 1} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4380ee92-e07b-46be-b045-f4f852a70185,created_at=2026-09-28T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77419323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4380ee92-e07b-46be-b045-f4f852a70185,host='devstack@QuobyteHD#QuobyteHD',id=4b0e4ac9-e420-4b4d-91bb-038036e94088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972c7cdf28d64e22ba56b47af7ddc8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:07Z,use_quota=True,user_id='b34c4b52b4de440fafa678948330fa85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46628b11-9fe9-4c32-b317-85a2748f5588),volume_type_id=46628b11-9fe9-4c32-b317-85a2748f5588)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Creating volume 4b0e4ac9-e420-4b4d-91bb-038036e94088 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:07 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:07 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 1073741824 Sep 28 15:05:07 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 1073741824" returned: 0 in 0.775s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:08 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 Sep 28 15:05:08 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088" returned: 0 in 0.440s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ff8c1d-b05f-4da4-bd40-27656296fc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0e4ac9-e420-4b4d-91bb-038036e94088', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fb2dc4-d707-44ec-a80c-c43a14122075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Volume volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 (4b0e4ac9-e420-4b4d-91bb-038036e94088): created successfully Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fb2dc4-d707-44ec-a80c-c43a14122075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Flow 'volume_create_manager' (c11a34c9-5c4f-4825-a017-fa26b9665e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:08 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-09f2d051-7f1c-4072-89a4-3936ac4107d8 tempest-GroupsTest-1305028637 None] Created volume successfully. Sep 28 15:05:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Acquiring lock "cinder-quobyte-4b0e4ac9-e420-4b4d-91bb-038036e94088" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Lock "cinder-quobyte-4b0e4ac9-e420-4b4d-91bb-038036e94088" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b191a93d-37d4-4744-90da-8a37069ada47]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:11 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 Sep 28 15:05:11 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088" returned: 0 in 0.789s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:11 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088 Sep 28 15:05:11 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2ca04fce-53ae-4243-8c61-185cc809578e tempest-GroupSnapshotsV319Test-317230289 None] Group tempest-GroupSnapshotsV319Test-Group-782516112: creating Sep 28 15:05:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2ca04fce-53ae-4243-8c61-185cc809578e tempest-GroupSnapshotsV319Test-317230289 None] Group tempest-GroupSnapshotsV319Test-Group-782516112: created successfully Sep 28 15:05:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2ca04fce-53ae-4243-8c61-185cc809578e tempest-GroupSnapshotsV319Test-317230289 None] Create group completed successfully. Sep 28 15:05:12 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4b0e4ac9-e420-4b4d-91bb-038036e94088" returned: 0 in 0.706s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Lock "cinder-quobyte-4b0e4ac9-e420-4b4d-91bb-038036e94088" released by "delete_volume" :: held 1.599s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Created reservations ['4d77f4ee-6e8e-4e53-83ce-494d86fd270b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:12 devstack cinder-volume[87124]: WARNING cinder.quota [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-711515366 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-711515366, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:12 devstack cinder-volume[87124]: WARNING cinder.quota [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-711515366 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-711515366, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Created reservations ['ed0a19ad-7414-410a-95d4-e3f54956b74e', 'a3e0e444-ab15-42b2-a655-7d216b18e338', '31b9b8a0-ae80-41b4-aa1b-a6eaf939ecef', 'a8bf9b86-04a0-4082-8ef3-af36bd15296e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:13 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:13 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.583s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b258a6af-e132-4d4b-952b-335f50d059c6 tempest-GroupsTest-1305028637 None] Delete group completed successfully. Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Created reservations ['8d3d961f-eb55-4f70-8cd7-fcde35cfcd51'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:13 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Flow 'volume_create_manager' (e082c073-6df5-463c-aa81-d87905b3d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc477e2f-ce6b-49d3-9da7-3abfaba74fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc477e2f-ce6b-49d3-9da7-3abfaba74fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318000953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ed77539-3e43-4219-b0c8-562a203ee28c,host='devstack@QuobyteHD#QuobyteHD',id=ca2e909f-1c14-4bc4-89b3-70951b52b17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578614548a4a437cb7bc65f4d32c980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:14Z,use_quota=True,user_id='dd229e94aa904833b38bf17263932b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0912bac3-f939-43a5-bd92-5af541653533),volume_type_id=0912bac3-f939-43a5-bd92-5af541653533)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047ec467-7527-481e-b02b-e10cc3d43f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047ec467-7527-481e-b02b-e10cc3d43f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c5ae61-9c2d-45f5-8c58-b8ebb8c23ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c5ae61-9c2d-45f5-8c58-b8ebb8c23ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2e909f-1c14-4bc4-89b3-70951b52b17f', 'volume_name': 'volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:14 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea429d4-0109-41c4-a2cb-cbdb31ff8feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea429d4-0109-41c4-a2cb-cbdb31ff8feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2aa5bf-fd2a-44b2-b0ee-0dc114514cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Volume ca2e909f-1c14-4bc4-89b3-70951b52b17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f', 'volume_size': 1} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ed77539-3e43-4219-b0c8-562a203ee28c,created_at=2026-09-28T13:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318000953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ed77539-3e43-4219-b0c8-562a203ee28c,host='devstack@QuobyteHD#QuobyteHD',id=ca2e909f-1c14-4bc4-89b3-70951b52b17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578614548a4a437cb7bc65f4d32c980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:14Z,use_quota=True,user_id='dd229e94aa904833b38bf17263932b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0912bac3-f939-43a5-bd92-5af541653533),volume_type_id=0912bac3-f939-43a5-bd92-5af541653533)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Creating volume ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:14 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.475s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:14 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a4b310ab-c919-47c5-945c-950b6e424d1c tempest-GroupsTest-1305028637 None] Delete group completed successfully. Sep 28 15:05:14 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f 1073741824 Sep 28 15:05:14 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:15 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f 1073741824" returned: 0 in 0.651s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:15 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f Sep 28 15:05:15 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:15 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f" returned: 0 in 0.342s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2aa5bf-fd2a-44b2-b0ee-0dc114514cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c241406-0399-4410-93d7-7c3cde5a331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:15 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Volume volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f (ca2e909f-1c14-4bc4-89b3-70951b52b17f): created successfully Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c241406-0399-4410-93d7-7c3cde5a331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Flow 'volume_create_manager' (e082c073-6df5-463c-aa81-d87905b3d24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1a8a3130-f47e-45d6-a506-6cdf3c100fa2 tempest-GroupSnapshotsV319Test-317230289 None] Created volume successfully. Sep 28 15:05:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4f02be82-eb5c-47b4-a859-614329656764 tempest-GroupsTest-1305028637 None] Group tempest-GroupsTest-Group-227288784: creating Sep 28 15:05:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4f02be82-eb5c-47b4-a859-614329656764 tempest-GroupsTest-1305028637 None] Group tempest-GroupsTest-Group-227288784: created successfully Sep 28 15:05:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4f02be82-eb5c-47b4-a859-614329656764 tempest-GroupsTest-1305028637 None] Create group completed successfully. Sep 28 15:05:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] GroupSnapshot 3003ce56-8b80-4ab1-802d-a321f5f7b38f: creating. Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Group snapshot 3003ce56-8b80-4ab1-802d-a321f5f7b38f: creating. {{(pid=87124) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Creating offline snapshot 27089ee3-8d90-4efb-8a6e-2b568b83f30d of volume ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebbc3f2-c9ad-4332-93db-034f24fefef1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f Sep 28 15:05:17 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Flow 'volume_create_manager' (253c0244-7811-4d3c-a045-1156a078de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccab34b-43c7-477e-a9fa-34c1a33093d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccab34b-43c7-477e-a9fa-34c1a33093d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-292129406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21b7e951-23f8-456c-ab78-8733be3caad2,host='devstack@QuobyteHD#QuobyteHD',id=97ae5e99-6e61-49cf-b047-4759dee7940f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972c7cdf28d64e22ba56b47af7ddc8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:18Z,use_quota=True,user_id='b34c4b52b4de440fafa678948330fa85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5e2d93a-3b79-4c69-be6b-44336acabe27),volume_type_id=f5e2d93a-3b79-4c69-be6b-44336acabe27)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496deed3-3698-4dd3-860b-e802dafeb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496deed3-3698-4dd3-860b-e802dafeb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2854a7e0-e8a2-4992-8527-75131df1f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2854a7e0-e8a2-4992-8527-75131df1f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ae5e99-6e61-49cf-b047-4759dee7940f', 'volume_name': 'volume-97ae5e99-6e61-49cf-b047-4759dee7940f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d8f8ea-55bb-4886-b70e-37d04da95276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d8f8ea-55bb-4886-b70e-37d04da95276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f580e316-6ac4-4a32-a208-887610ade095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Volume 97ae5e99-6e61-49cf-b047-4759dee7940f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ae5e99-6e61-49cf-b047-4759dee7940f', 'volume_size': 1} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:18 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f" returned: 0 in 0.674s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:18 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d 1G Sep 28 15:05:18 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:18 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d 1G" returned: 0 in 0.604s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:18 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d Sep 28 15:05:18 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:19 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d" returned: 0 in 0.648s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d Sep 28 15:05:19 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:19 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d" returned: 0 in 0.506s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info Sep 28 15:05:20 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info" returned: 0 in 0.391s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info Sep 28 15:05:20 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.info" returned: 0 in 0.422s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.411s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.691s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21b7e951-23f8-456c-ab78-8733be3caad2,created_at=2026-09-28T13:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-292129406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21b7e951-23f8-456c-ab78-8733be3caad2,host='devstack@QuobyteHD#QuobyteHD',id=97ae5e99-6e61-49cf-b047-4759dee7940f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972c7cdf28d64e22ba56b47af7ddc8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:18Z,use_quota=True,user_id='b34c4b52b4de440fafa678948330fa85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5e2d93a-3b79-4c69-be6b-44336acabe27),volume_type_id=f5e2d93a-3b79-4c69-be6b-44336acabe27)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Creating volume 97ae5e99-6e61-49cf-b047-4759dee7940f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:20 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f 1073741824 Sep 28 15:05:20 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0ae3a4cc-d250-4deb-97b8-5581646809fc tempest-GroupSnapshotsV319Test-317230289 None] group_snapshot 3003ce56-8b80-4ab1-802d-a321f5f7b38f: created successfully Sep 28 15:05:21 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f 1073741824" returned: 0 in 0.870s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f Sep 28 15:05:21 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f" returned: 0 in 0.628s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f580e316-6ac4-4a32-a208-887610ade095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ae5e99-6e61-49cf-b047-4759dee7940f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa0ce9d-209c-41b5-ae3e-2bd3b61a8fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:22 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Volume volume-97ae5e99-6e61-49cf-b047-4759dee7940f (97ae5e99-6e61-49cf-b047-4759dee7940f): created successfully Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa0ce9d-209c-41b5-ae3e-2bd3b61a8fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Flow 'volume_create_manager' (253c0244-7811-4d3c-a045-1156a078de77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:22 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-334dcfe9-6433-402b-ac7b-74b6e3778c8d tempest-GroupsTest-1305028637 None] Created volume successfully. Sep 28 15:05:22 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] group_snapshot 3003ce56-8b80-4ab1-802d-a321f5f7b38f: deleting Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] group_snapshot 3003ce56-8b80-4ab1-802d-a321f5f7b38f: deleting {{(pid=87124) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "cinder-quobyte-ca2e909f-1c14-4bc4-89b3-70951b52b17f" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Lock "cinder-quobyte-ca2e909f-1c14-4bc4-89b3-70951b52b17f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "cinder-quobyte-27089ee3-8d90-4efb-8a6e-2b568b83f30d" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Lock "cinder-quobyte-27089ee3-8d90-4efb-8a6e-2b568b83f30d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Deleting offline snapshot 27089ee3-8d90-4efb-8a6e-2b568b83f30d of volume ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] snapshot_file for this snap is: volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e4f2cc-2367-4600-96b5-d35f03ea4dba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:23 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d Sep 28 15:05:23 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:23 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d" returned: 0 in 0.616s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec20a25-4433-429e-b867-af5dd44fca7c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f Sep 28 15:05:24 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Flow 'volume_create_manager' (ee29eb22-f36b-4836-8dae-3359f35b75c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0b300d-afeb-45f2-a1d8-6de3893eb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0b300d-afeb-45f2-a1d8-6de3893eb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-243810157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21b7e951-23f8-456c-ab78-8733be3caad2,host='devstack@QuobyteHD#QuobyteHD',id=df73c026-4e55-474c-83b6-c393f85e1dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972c7cdf28d64e22ba56b47af7ddc8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:24Z,use_quota=True,user_id='b34c4b52b4de440fafa678948330fa85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5e2d93a-3b79-4c69-be6b-44336acabe27),volume_type_id=f5e2d93a-3b79-4c69-be6b-44336acabe27)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a89a6b-40cd-455d-8610-86ab630acc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a89a6b-40cd-455d-8610-86ab630acc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb108f55-dbca-4ad8-98e8-815d38efd9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb108f55-dbca-4ad8-98e8-815d38efd9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df73c026-4e55-474c-83b6-c393f85e1dcb', 'volume_name': 'volume-df73c026-4e55-474c-83b6-c393f85e1dcb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4619a8-bc50-42ec-9ddf-538c8ae09fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4619a8-bc50-42ec-9ddf-538c8ae09fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e86670f-b84e-4297-b4af-0a6ce479917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Volume df73c026-4e55-474c-83b6-c393f85e1dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df73c026-4e55-474c-83b6-c393f85e1dcb', 'volume_size': 1} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21b7e951-23f8-456c-ab78-8733be3caad2,created_at=2026-09-28T13:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-243810157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21b7e951-23f8-456c-ab78-8733be3caad2,host='devstack@QuobyteHD#QuobyteHD',id=df73c026-4e55-474c-83b6-c393f85e1dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972c7cdf28d64e22ba56b47af7ddc8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:24Z,use_quota=True,user_id='b34c4b52b4de440fafa678948330fa85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5e2d93a-3b79-4c69-be6b-44336acabe27),volume_type_id=f5e2d93a-3b79-4c69-be6b-44336acabe27)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Creating volume df73c026-4e55-474c-83b6-c393f85e1dcb {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:24 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb 1073741824 Sep 28 15:05:24 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f" returned: 0 in 0.820s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d Sep 28 15:05:24 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb 1073741824" returned: 0 in 0.635s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Flow 'volume_create_manager' (e3ac6aaf-e480-44c8-9c59-d5418f432f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62333780-bab9-48c3-ba6c-cf2fedf2ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62333780-bab9-48c3-ba6c-cf2fedf2ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2139667949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c541f4-e39a-4dd8-9b51-80cb34ae32f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c6493587df4334965c1b1da5a204ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:25Z,use_quota=True,user_id='dde16b77133743dd99ce8a017eab47d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f053416d-3d39-4da3-89ac-2211af97d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f053416d-3d39-4da3-89ac-2211af97d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9d7f6d-8d85-4dff-aa12-e2bc542b783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9d7f6d-8d85-4dff-aa12-e2bc542b783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c541f4-e39a-4dd8-9b51-80cb34ae32f0', 'volume_name': 'volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29aab77-03c8-46ae-8a93-5f25ec559c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29aab77-03c8-46ae-8a93-5f25ec559c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef628d1-3a4b-41b8-b7f8-84b74cdf07ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Volume 15c541f4-e39a-4dd8-9b51-80cb34ae32f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0', 'volume_size': 1} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d" returned: 0 in 0.500s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d Sep 28 15:05:25 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb Sep 28 15:05:25 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f.27089ee3-8d90-4efb-8a6e-2b568b83f30d" returned: 0 in 0.369s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Lock "cinder-quobyte-27089ee3-8d90-4efb-8a6e-2b568b83f30d" released by "_delete_snapshot" :: held 2.514s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb" returned: 0 in 0.383s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Lock "cinder-quobyte-ca2e909f-1c14-4bc4-89b3-70951b52b17f" released by "delete_snapshot" :: held 2.558s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2139667949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c541f4-e39a-4dd8-9b51-80cb34ae32f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c6493587df4334965c1b1da5a204ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:25Z,use_quota=True,user_id='dde16b77133743dd99ce8a017eab47d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Creating volume 15c541f4-e39a-4dd8-9b51-80cb34ae32f0 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:25 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e86670f-b84e-4297-b4af-0a6ce479917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df73c026-4e55-474c-83b6-c393f85e1dcb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 1073741824 Sep 28 15:05:25 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b569214-7979-4fcf-a8da-fa796a45a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Volume volume-df73c026-4e55-474c-83b6-c393f85e1dcb (df73c026-4e55-474c-83b6-c393f85e1dcb): created successfully Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b569214-7979-4fcf-a8da-fa796a45a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Flow 'volume_create_manager' (ee29eb22-f36b-4836-8dae-3359f35b75c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-920cfcb0-97df-4561-a328-6b711a95ea16 tempest-GroupsTest-1305028637 None] Created volume successfully. Sep 28 15:05:25 devstack cinder-volume[87124]: WARNING cinder.quota [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1989305001 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1989305001, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:25 devstack cinder-volume[87124]: WARNING cinder.quota [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1989305001 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1989305001, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:25 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] Created reservations ['d484cf06-f9c0-4406-942e-55c29fba00e7', 'f1141a85-9eb8-4e3a-a8b3-200280078ff6', '56e7b8aa-4a54-4ef4-991e-a062fc45c2de', '59062774-a740-41bd-956c-9386fbbb6c20'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dd2ec4b0-e491-4cc1-86c8-5f8bf8ce1f66 tempest-GroupSnapshotsV319Test-317230289 None] group_snapshot 3003ce56-8b80-4ab1-802d-a321f5f7b38f: deleted successfully Sep 28 15:05:26 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 1073741824" returned: 0 in 0.547s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 Sep 28 15:05:26 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:26 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0" returned: 0 in 0.349s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef628d1-3a4b-41b8-b7f8-84b74cdf07ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eb44f9-b004-470d-a2df-5edf600a4673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:26 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Volume volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 (15c541f4-e39a-4dd8-9b51-80cb34ae32f0): created successfully Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eb44f9-b004-470d-a2df-5edf600a4673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Flow 'volume_create_manager' (e3ac6aaf-e480-44c8-9c59-d5418f432f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-827f17f8-ff4a-4c95-acfb-cfe0ed718994 tempest-AttachVolumeTestJSON-770634496 None] Created volume successfully. Sep 28 15:05:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-eb5cc590-dc81-48f5-8d4a-559effca564c tempest-GroupsTest-1305028637 None] Update group completed successfully. Sep 28 15:05:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "cinder-quobyte-ca2e909f-1c14-4bc4-89b3-70951b52b17f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Lock "cinder-quobyte-ca2e909f-1c14-4bc4-89b3-70951b52b17f" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c85d90-aa49-4df0-aef2-621fa841343b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f Sep 28 15:05:27 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f" returned: 0 in 0.685s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f Sep 28 15:05:27 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-be7f485b-265f-47c9-a816-040ce19eb131 req-782cba8a-5934-407b-907c-928777e48d30 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-be7f485b-265f-47c9-a816-040ce19eb131 req-782cba8a-5934-407b-907c-928777e48d30 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-be7f485b-265f-47c9-a816-040ce19eb131 req-782cba8a-5934-407b-907c-928777e48d30 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:28 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca2e909f-1c14-4bc4-89b3-70951b52b17f" returned: 0 in 0.374s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-be7f485b-265f-47c9-a816-040ce19eb131 req-782cba8a-5934-407b-907c-928777e48d30 tempest-AttachVolumeTestJSON-770634496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb954a91-daea-4e2b-9322-31c92c773c9c', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Lock "cinder-quobyte-ca2e909f-1c14-4bc4-89b3-70951b52b17f" released by "delete_volume" :: held 1.226s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-be7f485b-265f-47c9-a816-040ce19eb131 req-782cba8a-5934-407b-907c-928777e48d30 tempest-AttachVolumeTestJSON-770634496 None] attachment_update completed successfully. Sep 28 15:05:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2a3f83a4-62b9-4c7b-8e86-89a851eddc55 tempest-GroupsTest-1305028637 None] Update group completed successfully. Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Created reservations ['ddd9015b-66e5-42d0-90f2-90e4cd63161e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:28 devstack cinder-volume[87124]: WARNING cinder.quota [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1989305001 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1989305001, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Created reservations ['043543c8-3e5e-49cb-8bc0-b7cdc81c941d', 'b24fc54a-ff41-4fde-9091-fd4cbeb22c40', '830d46f3-11e0-4f49-9208-9534a403cf10', 'e7e26c84-0f25-43ab-b5c4-136a1c2abc5e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:28 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.386s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-aa4d6c0b-181e-445d-ad0b-ed8a64f3de82 tempest-GroupSnapshotsV319Test-317230289 None] Delete group completed successfully. Sep 28 15:05:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Acquiring lock "cinder-quobyte-97ae5e99-6e61-49cf-b047-4759dee7940f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Lock "cinder-quobyte-97ae5e99-6e61-49cf-b047-4759dee7940f" acquired by "delete_volume" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491522e-01e2-43da-87d3-6b0530e24f3b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:30 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f Sep 28 15:05:30 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:30 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f" returned: 0 in 0.733s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:30 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f Sep 28 15:05:30 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:30 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-97ae5e99-6e61-49cf-b047-4759dee7940f" returned: 0 in 0.367s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Lock "cinder-quobyte-97ae5e99-6e61-49cf-b047-4759dee7940f" released by "delete_volume" :: held 1.214s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Acquiring lock "cinder-quobyte-df73c026-4e55-474c-83b6-c393f85e1dcb" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Lock "cinder-quobyte-df73c026-4e55-474c-83b6-c393f85e1dcb" acquired by "delete_volume" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5e51d-6c6b-49a3-ae22-8dc53e6d4bc3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb Sep 28 15:05:31 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Flow 'volume_create_manager' (1ee09240-67ae-4ca0-9281-a42776ecb50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ac6eb4-9def-4cf3-9847-5158dbf90dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ac6eb4-9def-4cf3-9847-5158dbf90dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1049676894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9445ad-47b4-41e2-b652-4f5601f0044d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c6493587df4334965c1b1da5a204ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:31Z,use_quota=True,user_id='dde16b77133743dd99ce8a017eab47d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512cf30d-30fb-4287-841f-87cf1e9cf5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512cf30d-30fb-4287-841f-87cf1e9cf5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f612f77-a0a6-47dd-9e76-786c57274b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f612f77-a0a6-47dd-9e76-786c57274b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a9445ad-47b4-41e2-b652-4f5601f0044d', 'volume_name': 'volume-8a9445ad-47b4-41e2-b652-4f5601f0044d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0068d59-d9eb-4cff-aec2-a3ab9c7ff9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0068d59-d9eb-4cff-aec2-a3ab9c7ff9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edf3c2a-76c9-4f42-bfc2-b5886c73b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Volume 8a9445ad-47b4-41e2-b652-4f5601f0044d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a9445ad-47b4-41e2-b652-4f5601f0044d', 'volume_size': 1} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1049676894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9445ad-47b4-41e2-b652-4f5601f0044d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c6493587df4334965c1b1da5a204ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:31Z,use_quota=True,user_id='dde16b77133743dd99ce8a017eab47d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Creating volume 8a9445ad-47b4-41e2-b652-4f5601f0044d {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:31 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d 1073741824 Sep 28 15:05:31 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb" returned: 0 in 0.649s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb Sep 28 15:05:31 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-df73c026-4e55-474c-83b6-c393f85e1dcb" returned: 0 in 0.323s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Lock "cinder-quobyte-df73c026-4e55-474c-83b6-c393f85e1dcb" released by "delete_volume" :: held 1.056s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:32 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d 1073741824" returned: 0 in 0.616s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Created reservations ['fef5f0dc-9fa6-4dfb-baef-e4dcc9c84f14'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:32 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d Sep 28 15:05:32 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack cinder-volume[87124]: WARNING cinder.quota [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-830886842 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-830886842, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:32 devstack cinder-volume[87124]: WARNING cinder.quota [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-830886842 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-830886842, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Created reservations ['fca74a0e-1071-4a6e-b574-e2e6ea2d1f8f', 'acbfecda-1d76-48d8-82fa-b977ee3dea87', '0da11f18-0e1e-4b2d-b774-1ff5f99f7267', '8f3e1a2e-ed50-4d5f-9440-28d06ebfa1e1'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Created reservations ['ab169893-2a9d-413b-8ca8-e36d4d877d59', '2d7b51b7-3c36-46a3-81bc-1c78c49bc14e', 'f770de42-e1b2-45e1-9d7c-46d616bc455a', '6ff41988-c418-411f-97fe-1612626c16d4'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:32 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d" returned: 0 in 0.568s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edf3c2a-76c9-4f42-bfc2-b5886c73b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9445ad-47b4-41e2-b652-4f5601f0044d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35717858-a412-482c-b9ee-badcbea78bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Volume volume-8a9445ad-47b4-41e2-b652-4f5601f0044d (8a9445ad-47b4-41e2-b652-4f5601f0044d): created successfully Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35717858-a412-482c-b9ee-badcbea78bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Flow 'volume_create_manager' (1ee09240-67ae-4ca0-9281-a42776ecb50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8e69949b-2ffa-42fe-bc08-5a03bff54d2f tempest-AttachVolumeTestJSON-770634496 None] Created volume successfully. Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:32 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:33 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:33 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0cc63e86-e2fd-408c-be6a-e26825a2309d tempest-GroupsTest-1305028637 None] Delete group completed successfully. Sep 28 15:05:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-04df7332-027b-44cc-a19a-25cac2825836 req-138af864-a254-4846-b038-c0c08213fcbe tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-04df7332-027b-44cc-a19a-25cac2825836 req-138af864-a254-4846-b038-c0c08213fcbe tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-04df7332-027b-44cc-a19a-25cac2825836 req-138af864-a254-4846-b038-c0c08213fcbe tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-04df7332-027b-44cc-a19a-25cac2825836 req-138af864-a254-4846-b038-c0c08213fcbe tempest-AttachVolumeTestJSON-770634496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-8a9445ad-47b4-41e2-b652-4f5601f0044d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d43eff4-172b-4dbd-9fee-9c0691181ebb', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:05:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-04df7332-027b-44cc-a19a-25cac2825836 req-138af864-a254-4846-b038-c0c08213fcbe tempest-AttachVolumeTestJSON-770634496 None] attachment_update completed successfully. Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:37 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:37 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:37 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:05:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:05:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-7ed1fb6f-878b-497b-8499-425d31585139 req-09b7930d-8628-456e-9226-ba314caf7dfd tempest-AttachVolumeTestJSON-770634496 None] Terminate volume connection completed successfully. Sep 28 15:05:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-7ed1fb6f-878b-497b-8499-425d31585139 req-09b7930d-8628-456e-9226-ba314caf7dfd tempest-AttachVolumeTestJSON-770634496 None] Deleting attachment fb954a91-daea-4e2b-9322-31c92c773c9c. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-a80a6c58-bdaa-4449-8223-deffa5dd2aa7 req-749e5ba7-66e4-4ca8-81d7-9f0536130239 tempest-AttachVolumeTestJSON-770634496 None] Terminate volume connection completed successfully. Sep 28 15:05:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-a80a6c58-bdaa-4449-8223-deffa5dd2aa7 req-749e5ba7-66e4-4ca8-81d7-9f0536130239 tempest-AttachVolumeTestJSON-770634496 None] Deleting attachment 3d43eff4-172b-4dbd-9fee-9c0691181ebb. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Flow 'volume_create_manager' (22da2d1c-a5f0-46f3-9b6c-3dfc6bb8c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf57af6-19cc-479c-9362-bcd3a029019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf57af6-19cc-479c-9362-bcd3a029019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1040332333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cc5baa-5336-4579-a0f6-a8c49ff769a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55012bf0b38545529eea28876568493b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:44Z,use_quota=True,user_id='292e32b52770402e8c5965480b0fa9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e348c7da-0b6d-4d20-b3e5-5412d2b14675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e348c7da-0b6d-4d20-b3e5-5412d2b14675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2388fa2-d25b-4471-bd81-b19c51ba43dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2388fa2-d25b-4471-bd81-b19c51ba43dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cc5baa-5336-4579-a0f6-a8c49ff769a0', 'volume_name': 'volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dd90c2-72b2-4834-8b3c-bce97178d5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dd90c2-72b2-4834-8b3c-bce97178d5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f42cade-23dc-4ed7-8f0b-9a21735711b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Volume 88cc5baa-5336-4579-a0f6-a8c49ff769a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0', 'volume_size': 1} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1040332333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cc5baa-5336-4579-a0f6-a8c49ff769a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55012bf0b38545529eea28876568493b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:44Z,use_quota=True,user_id='292e32b52770402e8c5965480b0fa9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Creating volume 88cc5baa-5336-4579-a0f6-a8c49ff769a0 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:43 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:43 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 1073741824 Sep 28 15:05:43 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 1073741824" returned: 0 in 0.808s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:44 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 Sep 28 15:05:44 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:45 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0" returned: 0 in 0.534s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f42cade-23dc-4ed7-8f0b-9a21735711b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77fb45d-eaa6-4d4c-9fdb-8bca8a1e06d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=102,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Volume volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 (88cc5baa-5336-4579-a0f6-a8c49ff769a0): created successfully Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77fb45d-eaa6-4d4c-9fdb-8bca8a1e06d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Flow 'volume_create_manager' (22da2d1c-a5f0-46f3-9b6c-3dfc6bb8c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-fe898a6e-5b36-4ecc-b541-c673492a4cf9 tempest-AttachVolumeNegativeTest-1483546106 None] Created volume successfully. Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=99,cinder:SELECT=106,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Flow 'volume_create_manager' (d38cfc13-1af8-4f09-a408-2d3c2be7d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981cd05c-da4c-40cb-9abb-71aad99f6fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981cd05c-da4c-40cb-9abb-71aad99f6fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1942853384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcd4eab-51e4-49b0-9b04-8fe7550363b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3db556bdc744d50a474ea6aeb3fd694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:47Z,use_quota=True,user_id='8d7dc9532c9d4ff28d89deb323b92208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c59191-23a2-4c8b-bf6c-3cfff98a6d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c59191-23a2-4c8b-bf6c-3cfff98a6d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef44ddd1-65c9-44aa-bab8-4460ba43553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef44ddd1-65c9-44aa-bab8-4460ba43553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcd4eab-51e4-49b0-9b04-8fe7550363b1', 'volume_name': 'volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f60e02-ceac-4606-b0ba-45309e3fa72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f60e02-ceac-4606-b0ba-45309e3fa72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f550a01d-eed6-4dd5-a058-cd26868e602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Volume 3bcd4eab-51e4-49b0-9b04-8fe7550363b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1', 'volume_size': 1} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1942853384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcd4eab-51e4-49b0-9b04-8fe7550363b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3db556bdc744d50a474ea6aeb3fd694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:47Z,use_quota=True,user_id='8d7dc9532c9d4ff28d89deb323b92208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Creating volume 3bcd4eab-51e4-49b0-9b04-8fe7550363b1 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:47 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 1073741824 Sep 28 15:05:47 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-73012561-ef3d-43d3-92c3-9a10d99981b4 req-142ed915-cbb4-481e-be20-245708600dca tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:47 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 1073741824" returned: 0 in 0.745s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 Sep 28 15:05:47 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "cinder-8a9445ad-47b4-41e2-b652-4f5601f0044d-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-8a9445ad-47b4-41e2-b652-4f5601f0044d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "cinder-quobyte-8a9445ad-47b4-41e2-b652-4f5601f0044d" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-quobyte-8a9445ad-47b4-41e2-b652-4f5601f0044d" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:48 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-73012561-ef3d-43d3-92c3-9a10d99981b4 req-142ed915-cbb4-481e-be20-245708600dca tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.080s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed53e7ab-c75e-4a1e-a875-9c8e52285b8a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f550a01d-eed6-4dd5-a058-cd26868e602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5649da6-d73b-443d-ab83-0077070d5b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-73012561-ef3d-43d3-92c3-9a10d99981b4 req-142ed915-cbb4-481e-be20-245708600dca tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.066s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Volume volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 (3bcd4eab-51e4-49b0-9b04-8fe7550363b1): created successfully Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5649da6-d73b-443d-ab83-0077070d5b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Flow 'volume_create_manager' (d38cfc13-1af8-4f09-a408-2d3c2be7d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4c598e1f-6e76-4964-8564-bf807fc2a677 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Created volume successfully. Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-73012561-ef3d-43d3-92c3-9a10d99981b4 req-142ed915-cbb4-481e-be20-245708600dca tempest-AttachVolumeNegativeTest-1483546106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd256d7b0-1d93-42d9-af69-eedcee65b7c6', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:05:48 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d Sep 28 15:05:48 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-73012561-ef3d-43d3-92c3-9a10d99981b4 req-142ed915-cbb4-481e-be20-245708600dca tempest-AttachVolumeNegativeTest-1483546106 None] attachment_update completed successfully. Sep 28 15:05:48 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d" returned: 0 in 0.575s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d Sep 28 15:05:48 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8a9445ad-47b4-41e2-b652-4f5601f0044d" returned: 0 in 0.499s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-quobyte-8a9445ad-47b4-41e2-b652-4f5601f0044d" released by "delete_volume" :: held 1.156s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "cinder-3bcd4eab-51e4-49b0-9b04-8fe7550363b1-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "cinder-3bcd4eab-51e4-49b0-9b04-8fe7550363b1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Created reservations ['9fe7f85e-e734-4f35-858c-ca49badc0e36', 'a5e37862-7d30-4ec5-bb2c-8c5395564b46', '6b7c901f-150c-40ac-a868-52c45920d85d', '81a4c5b4-09dc-42ed-b24f-3e9777fa6658'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "cinder-quobyte-3bcd4eab-51e4-49b0-9b04-8fe7550363b1" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "cinder-quobyte-3bcd4eab-51e4-49b0-9b04-8fe7550363b1" acquired by "delete_volume" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15e3e5-3415-44b8-bd83-ccc7c36cb514]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:49 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:49 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 Sep 28 15:05:49 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:50 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1" returned: 0 in 0.813s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:50 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.658s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:50 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1 Sep 28 15:05:50 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Deleted volume successfully. Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b28ac82e-e3d6-4fe4-8304-451429eb5243 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-8a9445ad-47b4-41e2-b652-4f5601f0044d-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "cinder-15c541f4-e39a-4dd8-9b51-80cb34ae32f0-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-15c541f4-e39a-4dd8-9b51-80cb34ae32f0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "cinder-quobyte-15c541f4-e39a-4dd8-9b51-80cb34ae32f0" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-quobyte-15c541f4-e39a-4dd8-9b51-80cb34ae32f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89bf162-2fc3-4bbc-b738-6971fccb7d4c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:50 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 Sep 28 15:05:50 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:50 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3bcd4eab-51e4-49b0-9b04-8fe7550363b1" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "cinder-quobyte-3bcd4eab-51e4-49b0-9b04-8fe7550363b1" released by "delete_volume" :: held 1.383s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Created reservations ['cfbb0663-6966-4576-a64a-2ae5aa6887cb', '3ac400d5-c5fd-4141-9553-80e4f470c20c', 'aa205258-73f1-41dc-bd22-c96f1f74afd2', '1789dce1-2d73-4d4f-8d53-8bfa47e17d6e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:51 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:51 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0" returned: 0 in 0.562s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:51 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0 Sep 28 15:05:51 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.472s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Deleted volume successfully. Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64990ba1-be76-44bf-9a07-c7fd6f23d8db tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "cinder-3bcd4eab-51e4-49b0-9b04-8fe7550363b1-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:51 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-15c541f4-e39a-4dd8-9b51-80cb34ae32f0" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-quobyte-15c541f4-e39a-4dd8-9b51-80cb34ae32f0" released by "delete_volume" :: held 1.102s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Created reservations ['3f62b6af-07f4-4ef1-a53d-dbe75ab4b257', '7ca7e2ba-b28a-48c6-9e43-905400434828', '22295b25-366f-4d8e-9661-5b4c3d2887a1', '706d5271-03e0-4e66-a988-1fb66d606c05'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:52 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:52 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:52 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Deleted volume successfully. Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1971aac9-4882-42c1-90be-45b0c9530ee3 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-15c541f4-e39a-4dd8-9b51-80cb34ae32f0-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Flow 'volume_create_manager' (03788476-4fc7-4703-afd0-682e410c179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9633fa-38ce-4576-abba-487c132a62ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9633fa-38ce-4576-abba-487c132a62ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-411094202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4f3a76-57d5-48db-a0d2-4560726c0d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3db556bdc744d50a474ea6aeb3fd694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:53Z,use_quota=True,user_id='8d7dc9532c9d4ff28d89deb323b92208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0106b2-0853-4701-9868-7e38ad5d051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0106b2-0853-4701-9868-7e38ad5d051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439e7b97-d4fe-43a3-a90e-602e62f34522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439e7b97-d4fe-43a3-a90e-602e62f34522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4f3a76-57d5-48db-a0d2-4560726c0d48', 'volume_name': 'volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4dd2ec-2d92-44da-b82c-c30049454f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4dd2ec-2d92-44da-b82c-c30049454f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157c525e-5b78-475e-8862-a096ba6adb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Volume 3b4f3a76-57d5-48db-a0d2-4560726c0d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48', 'volume_size': 1} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-411094202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4f3a76-57d5-48db-a0d2-4560726c0d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3db556bdc744d50a474ea6aeb3fd694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:53Z,use_quota=True,user_id='8d7dc9532c9d4ff28d89deb323b92208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Creating volume 3b4f3a76-57d5-48db-a0d2-4560726c0d48 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:52 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-dabee5ab-cfe7-479d-ad4d-f73b0ca04599 req-28e08532-2072-4a64-b668-bbb4459e8666 tempest-AttachVolumeNegativeTest-1483546106 None] Terminate volume connection completed successfully. Sep 28 15:05:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-dabee5ab-cfe7-479d-ad4d-f73b0ca04599 req-28e08532-2072-4a64-b668-bbb4459e8666 tempest-AttachVolumeNegativeTest-1483546106 None] Deleting attachment d256d7b0-1d93-42d9-af69-eedcee65b7c6. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:52 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 1073741824 Sep 28 15:05:52 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "cinder-a7aa9356-b787-4090-8d0a-8170f44a00d0-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-a7aa9356-b787-4090-8d0a-8170f44a00d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "cinder-quobyte-a7aa9356-b787-4090-8d0a-8170f44a00d0" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-quobyte-a7aa9356-b787-4090-8d0a-8170f44a00d0" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fa3b79-fe62-4cff-a960-0db69789f05d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:53 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 Sep 28 15:05:53 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 1073741824" returned: 0 in 0.610s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:53 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 Sep 28 15:05:53 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0" returned: 0 in 0.531s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:53 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0 Sep 28 15:05:53 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157c525e-5b78-475e-8862-a096ba6adb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9264be9-d030-4682-bcb1-44c65bc9109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Volume volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 (3b4f3a76-57d5-48db-a0d2-4560726c0d48): created successfully Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9264be9-d030-4682-bcb1-44c65bc9109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Flow 'volume_create_manager' (03788476-4fc7-4703-afd0-682e410c179e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-100f4233-119d-48f7-a692-e0523a748626 tempest-VolumeQuotasAdminTestJSON-1206434855 None] Created volume successfully. Sep 28 15:05:54 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7aa9356-b787-4090-8d0a-8170f44a00d0" returned: 0 in 0.305s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-quobyte-a7aa9356-b787-4090-8d0a-8170f44a00d0" released by "delete_volume" :: held 0.894s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Created reservations ['98d003a3-9499-4d00-b66c-95518a194a91', '5113082e-6cf8-4a36-b0e3-437a5185ffd8', '376bd7fb-ea1e-4d8f-8787-9247c073fb10', 'd856cca1-f732-4298-b029-d7c2891f3113'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:54 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:54 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:54 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.350s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Deleted volume successfully. Sep 28 15:05:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4de8f1ea-1430-482f-a302-a2adfe911c73 tempest-AttachVolumeTestJSON-770634496 None] Lock "cinder-a7aa9356-b787-4090-8d0a-8170f44a00d0-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d52c7782-0071-4e90-9e01-12b15e1b6bea tempest-VolumeQuotasAdminTestJSON-1980700638 None] Transfer volume completed successfully. Sep 28 15:05:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Acquiring lock "cinder-3b4f3a76-57d5-48db-a0d2-4560726c0d48-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Lock "cinder-3b4f3a76-57d5-48db-a0d2-4560726c0d48-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Acquiring lock "cinder-quobyte-3b4f3a76-57d5-48db-a0d2-4560726c0d48" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Lock "cinder-quobyte-3b4f3a76-57d5-48db-a0d2-4560726c0d48" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31f20ed-2f2b-4d15-90f4-7b6904048cb7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:57 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 Sep 28 15:05:57 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:57 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48" returned: 0 in 0.570s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:57 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48 Sep 28 15:05:57 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:58 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3b4f3a76-57d5-48db-a0d2-4560726c0d48" returned: 0 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Lock "cinder-quobyte-3b4f3a76-57d5-48db-a0d2-4560726c0d48" released by "delete_volume" :: held 1.004s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Created reservations ['5792db7a-46ac-4efb-86ba-668a5567facd', '61b061c7-b9e6-4c9d-b419-6b07f0a3e97b', 'd9099891-2e02-409a-b31c-68ab0ca322f5', '842bca68-b9b7-4688-8d2b-ced8d31fd7de'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:58 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:05:58 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:58 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.400s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Deleted volume successfully. Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1af9f8b-622f-49ac-ab2e-6ae74e05b144 tempest-VolumeQuotasAdminTestJSON-295429073 None] Lock "cinder-3b4f3a76-57d5-48db-a0d2-4560726c0d48-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "cinder-88cc5baa-5336-4579-a0f6-a8c49ff769a0-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-88cc5baa-5336-4579-a0f6-a8c49ff769a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "cinder-quobyte-88cc5baa-5336-4579-a0f6-a8c49ff769a0" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-quobyte-88cc5baa-5336-4579-a0f6-a8c49ff769a0" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[256710f1-9254-4b1c-9647-8c4a0ea7a44d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:59 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 Sep 28 15:05:59 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:59 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0" returned: 0 in 0.467s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:59 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0 Sep 28 15:05:59 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:59 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-88cc5baa-5336-4579-a0f6-a8c49ff769a0" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-quobyte-88cc5baa-5336-4579-a0f6-a8c49ff769a0" released by "delete_volume" :: held 0.916s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Created reservations ['1e666768-f73c-4249-b157-a0456334fcde', 'b209b694-4e8a-4d63-aaaa-3e5849ffd008', 'fb866195-90ed-4eaf-aa9a-be7ac057b632', '83a1f25b-e3de-484e-aafa-20050af9fa97'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:00 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:00 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:00 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.348s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Deleted volume successfully. Sep 28 15:06:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-11e6963d-c72a-43ad-8d9c-85f78b7207d1 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-88cc5baa-5336-4579-a0f6-a8c49ff769a0-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "cinder-9a071bef-441b-49c4-a52a-1a5537ef94d2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-9a071bef-441b-49c4-a52a-1a5537ef94d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "cinder-quobyte-9a071bef-441b-49c4-a52a-1a5537ef94d2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-quobyte-9a071bef-441b-49c4-a52a-1a5537ef94d2" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:01 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bfeab-7764-4e5d-8bb5-54bfa5d4b112]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:01 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 Sep 28 15:06:01 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:02 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2" returned: 0 in 0.514s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:02 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2 Sep 28 15:06:02 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:02 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9a071bef-441b-49c4-a52a-1a5537ef94d2" returned: 0 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-quobyte-9a071bef-441b-49c4-a52a-1a5537ef94d2" released by "delete_volume" :: held 1.089s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Created reservations ['c91d5fb2-ebc3-487a-9860-94e48639fe54', '9ada925e-cff7-4f50-ba50-b8e5a77da462', '85587584-6696-4272-ad78-fc0ae282675a', '44825e2f-96e5-4758-b587-ef0d9c5d87aa'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:02 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:02 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:03 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:03 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Deleted volume successfully. Sep 28 15:06:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d33b2a1d-aed6-422a-922b-1197f8ece05f tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-9a071bef-441b-49c4-a52a-1a5537ef94d2-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "cinder-c5e0bb58-326b-4931-87d2-ee17ca0e06a1-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-c5e0bb58-326b-4931-87d2-ee17ca0e06a1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "cinder-quobyte-c5e0bb58-326b-4931-87d2-ee17ca0e06a1" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-quobyte-c5e0bb58-326b-4931-87d2-ee17ca0e06a1" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:04 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd14ed-6ef4-41dd-9e91-95c815d7ca66]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:04 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 Sep 28 15:06:04 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:05 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1" returned: 0 in 0.749s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:05 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1 Sep 28 15:06:05 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:05 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c5e0bb58-326b-4931-87d2-ee17ca0e06a1" returned: 0 in 0.476s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-quobyte-c5e0bb58-326b-4931-87d2-ee17ca0e06a1" released by "delete_volume" :: held 1.293s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Created reservations ['eee61861-58e6-4b55-bbac-c3345d88eb52', '1627450f-1024-456a-91d3-98d713701c3a', 'bfa39887-4993-4b3e-a0e5-20848971b489', '7ef4cc2d-72dd-4960-bb82-880ee1b4730d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:05 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:05 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:06 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.332s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:06 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Deleted volume successfully. Sep 28 15:06:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3ce4bc58-25c9-4995-9a67-0e66721101a5 tempest-AttachVolumeNegativeTest-1483546106 None] Lock "cinder-c5e0bb58-326b-4931-87d2-ee17ca0e06a1-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:08 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Flow 'volume_create_manager' (f5ca5e20-b22e-4001-86fa-937c7b0e36e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a575ec-66d0-4369-ae9a-94a1f19cf969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a575ec-66d0-4369-ae9a-94a1f19cf969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-855413622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3108f6-e740-42eb-bf06-1c8029dbabe7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23cd7ad9eb334864ba0d7ec6a9c9ba77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:09Z,use_quota=True,user_id='8bf8202528d947c38a69144107a64289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b60c16-a794-4137-8632-a9a38e0109db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b60c16-a794-4137-8632-a9a38e0109db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae72cd2-5aed-4832-b5e6-2bbfe08c606d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae72cd2-5aed-4832-b5e6-2bbfe08c606d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3108f6-e740-42eb-bf06-1c8029dbabe7', 'volume_name': 'volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82210ed5-17de-4ce3-80a3-532fd85a57fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82210ed5-17de-4ce3-80a3-532fd85a57fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cc8c01-c904-4e5c-abee-56fc562438f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Volume 3c3108f6-e740-42eb-bf06-1c8029dbabe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7', 'volume_size': 1} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-855413622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3108f6-e740-42eb-bf06-1c8029dbabe7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23cd7ad9eb334864ba0d7ec6a9c9ba77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:09Z,use_quota=True,user_id='8bf8202528d947c38a69144107a64289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Creating volume 3c3108f6-e740-42eb-bf06-1c8029dbabe7 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:09 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:09 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 1073741824 Sep 28 15:06:09 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:09 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 1073741824" returned: 0 in 0.641s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:09 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 Sep 28 15:06:09 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:10 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7" returned: 0 in 0.327s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cc8c01-c904-4e5c-abee-56fc562438f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68e82a4-b587-436e-b33c-57afc65b9752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Volume volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 (3c3108f6-e740-42eb-bf06-1c8029dbabe7): created successfully Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68e82a4-b587-436e-b33c-57afc65b9752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Flow 'volume_create_manager' (f5ca5e20-b22e-4001-86fa-937c7b0e36e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0a51e352-2cca-4240-8101-e0066ffd39d0 tempest-VolumesTestJSON-923346011 None] Created volume successfully. Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Flow 'volume_create_manager' (158585d8-7e67-408e-ba2e-b97f6bd27d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43797f20-b468-4174-9ec3-73f3935be024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43797f20-b468-4174-9ec3-73f3935be024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1605943553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93337d82-b6ea-4cac-a8a5-ba4dd4679f6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23cd7ad9eb334864ba0d7ec6a9c9ba77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:12Z,use_quota=True,user_id='8bf8202528d947c38a69144107a64289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5d8e88-b4c0-402c-9dd8-2b24a6b07e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5d8e88-b4c0-402c-9dd8-2b24a6b07e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b49c50c-d4c7-48c5-89e9-5a088e96fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b49c50c-d4c7-48c5-89e9-5a088e96fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93337d82-b6ea-4cac-a8a5-ba4dd4679f6a', 'volume_name': 'volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1355023b-4af2-490b-b600-6799f0d64733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1355023b-4af2-490b-b600-6799f0d64733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7753549-add5-42bb-bf1a-47a61e59e3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:12 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Volume 93337d82-b6ea-4cac-a8a5-ba4dd4679f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a', 'volume_size': 1} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1605943553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93337d82-b6ea-4cac-a8a5-ba4dd4679f6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23cd7ad9eb334864ba0d7ec6a9c9ba77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:12Z,use_quota=True,user_id='8bf8202528d947c38a69144107a64289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Creating volume 93337d82-b6ea-4cac-a8a5-ba4dd4679f6a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:12 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:12 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a 1073741824 Sep 28 15:06:12 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:12 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a 1073741824" returned: 0 in 0.734s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:13 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a Sep 28 15:06:13 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:13 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a" returned: 0 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7753549-add5-42bb-bf1a-47a61e59e3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857edd3b-552e-4af7-8b7e-201fe7b51a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Volume volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a (93337d82-b6ea-4cac-a8a5-ba4dd4679f6a): created successfully Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857edd3b-552e-4af7-8b7e-201fe7b51a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Flow 'volume_create_manager' (158585d8-7e67-408e-ba2e-b97f6bd27d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-694822b7-123b-4b62-9cde-6cf11233c93c tempest-VolumesTestJSON-923346011 None] Created volume successfully. Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Flow 'volume_create_manager' (da39765a-3418-4044-9c43-53abaddffaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a777e1f5-111e-4ac7-978a-d7ba66ba409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a777e1f5-111e-4ac7-978a-d7ba66ba409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2126854979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31880db-44a1-40b3-a692-0b776e44ee4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da987711f898434bb162344004c53a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:14Z,use_quota=True,user_id='3f9dd7f81c744788a42d5803cf181928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b4b197-ac60-42ca-8f41-dd691f6a67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b4b197-ac60-42ca-8f41-dd691f6a67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbe0c2d-79c5-4acf-92ec-b6d2587f195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbe0c2d-79c5-4acf-92ec-b6d2587f195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31880db-44a1-40b3-a692-0b776e44ee4e', 'volume_name': 'volume-a31880db-44a1-40b3-a692-0b776e44ee4e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4327d5-2644-4151-a4e1-3d84ff9e0132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4327d5-2644-4151-a4e1-3d84ff9e0132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89211a2-ba43-4a7e-9c68-92ff4f9ff129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Volume a31880db-44a1-40b3-a692-0b776e44ee4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31880db-44a1-40b3-a692-0b776e44ee4e', 'volume_size': 1} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2126854979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31880db-44a1-40b3-a692-0b776e44ee4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da987711f898434bb162344004c53a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:14Z,use_quota=True,user_id='3f9dd7f81c744788a42d5803cf181928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Creating volume a31880db-44a1-40b3-a692-0b776e44ee4e {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:13 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:14 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e 1073741824 Sep 28 15:06:14 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:14 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e 1073741824" returned: 0 in 0.706s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:14 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e Sep 28 15:06:14 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Flow 'volume_create_manager' (ec9927b7-59d9-44c1-8f2d-b1ff735e223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e83d38-19ad-449e-89fa-86c69c4db7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e83d38-19ad-449e-89fa-86c69c4db7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-102450736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cb5e37-9264-4826-bb50-75d5d9e4e6ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23cd7ad9eb334864ba0d7ec6a9c9ba77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:15Z,use_quota=True,user_id='8bf8202528d947c38a69144107a64289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e34215-14c7-40b9-8e1e-b990987c0110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e34215-14c7-40b9-8e1e-b990987c0110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e139aae-4b9e-46eb-a78e-4c3df70834e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e139aae-4b9e-46eb-a78e-4c3df70834e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cb5e37-9264-4826-bb50-75d5d9e4e6ae', 'volume_name': 'volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd733d7c-f7b3-4659-b995-7703fb48a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd733d7c-f7b3-4659-b995-7703fb48a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9b47b1-60e0-45ce-88c1-7056c03e70c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Volume c8cb5e37-9264-4826-bb50-75d5d9e4e6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae', 'volume_size': 1} Sep 28 15:06:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:15 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e" returned: 0 in 0.431s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-102450736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cb5e37-9264-4826-bb50-75d5d9e4e6ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23cd7ad9eb334864ba0d7ec6a9c9ba77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:15Z,use_quota=True,user_id='8bf8202528d947c38a69144107a64289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Creating volume c8cb5e37-9264-4826-bb50-75d5d9e4e6ae {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:15 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89211a2-ba43-4a7e-9c68-92ff4f9ff129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31880db-44a1-40b3-a692-0b776e44ee4e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263879fa-6388-4c34-9ef0-b621e4cbfc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae 1073741824 Sep 28 15:06:15 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:15 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Volume volume-a31880db-44a1-40b3-a692-0b776e44ee4e (a31880db-44a1-40b3-a692-0b776e44ee4e): created successfully Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263879fa-6388-4c34-9ef0-b621e4cbfc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Flow 'volume_create_manager' (da39765a-3418-4044-9c43-53abaddffaa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-35c0a241-97e4-4a0d-b9d2-c07a3ba01a96 tempest-VolumeQuotasNegativeTestJSON-642408430 None] Created volume successfully. Sep 28 15:06:15 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae 1073741824" returned: 0 in 0.692s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:16 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae Sep 28 15:06:16 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:16 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae" returned: 0 in 0.332s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9b47b1-60e0-45ce-88c1-7056c03e70c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412729fd-a9ef-4401-8bd3-34cc8f66b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:16 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Volume volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae (c8cb5e37-9264-4826-bb50-75d5d9e4e6ae): created successfully Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412729fd-a9ef-4401-8bd3-34cc8f66b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Flow 'volume_create_manager' (ec9927b7-59d9-44c1-8f2d-b1ff735e223e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9b7533cd-b128-4154-b641-7a02e32b8055 tempest-VolumesTestJSON-923346011 None] Created volume successfully. Sep 28 15:06:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Acquiring lock "cinder-a31880db-44a1-40b3-a692-0b776e44ee4e-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "cinder-a31880db-44a1-40b3-a692-0b776e44ee4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Acquiring lock "cinder-quobyte-a31880db-44a1-40b3-a692-0b776e44ee4e" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "cinder-quobyte-a31880db-44a1-40b3-a692-0b776e44ee4e" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[01753831-e86a-4270-abb8-7b3b9ab08b3c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:17 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e Sep 28 15:06:17 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:18 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e" returned: 0 in 0.555s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:18 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e Sep 28 15:06:18 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:18 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a31880db-44a1-40b3-a692-0b776e44ee4e" returned: 0 in 0.507s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "cinder-quobyte-a31880db-44a1-40b3-a692-0b776e44ee4e" released by "delete_volume" :: held 1.124s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Created reservations ['958ec332-5cb9-4589-99a8-cdc34c28160f', '5d52dfc7-9d6f-43ae-a3bc-02ca701420b1', '7f42e5ce-6d9d-46a4-b2ba-54a7997946cd', '10d50657-6182-4988-bcad-0593d7695a70'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Acquiring lock "cinder-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Lock "cinder-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Acquiring lock "cinder-quobyte-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:18 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:18 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Lock "cinder-quobyte-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc9332-d17d-4ffe-8c0c-d2517aa32aa0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:19 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae Sep 28 15:06:19 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Flow 'volume_create_manager' (d497d03c-1676-49b9-82ad-c0c44732d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aec4210-bbd7-4c6d-bdd0-621fc8b87c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.364s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aec4210-bbd7-4c6d-bdd0-621fc8b87c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-785829957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5065dc8e-9bd2-42fa-9a66-f4eab82f64c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7edd118ba24b17b5685d19b79e9832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:19Z,use_quota=True,user_id='4738a540fb6b4b7c92eac8814e8c42e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba56264-5148-4ebd-9425-0026cdcddb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba56264-5148-4ebd-9425-0026cdcddb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51961527-2637-4833-a85d-35766dc147e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51961527-2637-4833-a85d-35766dc147e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5065dc8e-9bd2-42fa-9a66-f4eab82f64c5', 'volume_name': 'volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5bc9a5-15f3-4f30-8822-51bde6d3d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5bc9a5-15f3-4f30-8822-51bde6d3d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1352565-9420-4bb4-bd6f-8d5d266f7576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Volume 5065dc8e-9bd2-42fa-9a66-f4eab82f64c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5', 'volume_size': 1} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-785829957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5065dc8e-9bd2-42fa-9a66-f4eab82f64c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7edd118ba24b17b5685d19b79e9832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:19Z,use_quota=True,user_id='4738a540fb6b4b7c92eac8814e8c42e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Creating volume 5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:19 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Deleted volume successfully. Sep 28 15:06:19 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 1073741824 Sep 28 15:06:19 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d188559-0358-4373-b880-55263cc012de tempest-VolumeQuotasNegativeTestJSON-642408430 None] Lock "cinder-a31880db-44a1-40b3-a692-0b776e44ee4e-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:19 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae" returned: 0 in 0.478s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae Sep 28 15:06:19 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae" returned: 0 in 0.320s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Lock "cinder-quobyte-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae" released by "delete_volume" :: held 0.880s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:19 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Created reservations ['f3de62d0-16d1-4134-83f4-1f408908ac51', '91534118-b405-4af3-84ae-15a4a9cfa60d', '3a7c484c-8a23-4422-8713-a3b515e2c0fe', '329ae2d5-c9c5-4c0e-b6b4-b9819e57b89e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:20 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 1073741824" returned: 0 in 0.727s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:20 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:20 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Acquiring lock "cinder-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Lock "cinder-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:20 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 Sep 28 15:06:20 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Acquiring lock "cinder-quobyte-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Lock "cinder-quobyte-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaee06e-c959-43d0-b66b-232c660939ae]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:20 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a Sep 28 15:06:20 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:20 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Deleted volume successfully. Sep 28 15:06:20 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1352565-9420-4bb4-bd6f-8d5d266f7576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa64e0d-b0ac-40b9-8cfc-053826d749be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc49f44d-2881-4621-b252-fc1aeff3ebea tempest-VolumesTestJSON-923346011 None] Lock "cinder-c8cb5e37-9264-4826-bb50-75d5d9e4e6ae-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Volume volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 (5065dc8e-9bd2-42fa-9a66-f4eab82f64c5): created successfully Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa64e0d-b0ac-40b9-8cfc-053826d749be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Flow 'volume_create_manager' (d497d03c-1676-49b9-82ad-c0c44732d76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-486744f8-8b80-48be-944c-bfcbec2e8f01 req-5ecd4c5b-c185-4277-a715-ddd2983b95fc tempest-VolumesSnapshotsTestJSON-2033050784 None] Created volume successfully. Sep 28 15:06:20 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a" returned: 0 in 0.553s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:20 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a Sep 28 15:06:20 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:21 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a" returned: 0 in 0.303s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Lock "cinder-quobyte-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a" released by "delete_volume" :: held 0.935s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Created reservations ['04815c30-3cd4-4d81-9cda-e619018dd9e1', 'f20fd952-bed0-442d-b274-e7c87485c543', 'f50502b3-8e70-47d3-93e4-6c9445acbda8', 'a71756e2-ebb0-4a22-b241-1a9ed1fdb7f4'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:21 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:21 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Acquiring lock "cinder-3c3108f6-e740-42eb-bf06-1c8029dbabe7-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Lock "cinder-3c3108f6-e740-42eb-bf06-1c8029dbabe7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Acquiring lock "cinder-quobyte-3c3108f6-e740-42eb-bf06-1c8029dbabe7" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Lock "cinder-quobyte-3c3108f6-e740-42eb-bf06-1c8029dbabe7" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efaa307-fe0c-4203-84c6-067e2ade0596]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:21 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.414s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Deleted volume successfully. Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95b854d5-ef6d-4cf9-bbbe-36bafb6c55ea tempest-VolumesTestJSON-923346011 None] Lock "cinder-93337d82-b6ea-4cac-a8a5-ba4dd4679f6a-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:21 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 Sep 28 15:06:21 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Creating offline snapshot c20a5609-58db-45f8-93f4-235e240dd7d9 of volume 5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[89378f4b-9fa3-4269-900e-6a96a7f74f6d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:22 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 Sep 28 15:06:22 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:22 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7" returned: 0 in 0.654s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:22 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7 Sep 28 15:06:22 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:22 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" returned: 0 in 0.769s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:22 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3c3108f6-e740-42eb-bf06-1c8029dbabe7" returned: 0 in 0.463s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:22 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 1G Sep 28 15:06:22 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Lock "cinder-quobyte-3c3108f6-e740-42eb-bf06-1c8029dbabe7" released by "delete_volume" :: held 1.208s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Created reservations ['49738998-16ed-4cba-b4e6-86c12cd177e9', '1df23709-7691-47eb-88f2-f0fbec1842a2', 'd7063b29-4ffd-4af3-bca4-096733b0ab40', 'aefbdf7a-8ea9-4803-a68a-8b5e1621af65'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:23 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:23 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:23 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.316s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Deleted volume successfully. Sep 28 15:06:23 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 1G" returned: 0 in 0.606s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f35fc18a-7114-45d8-9458-e4ffb2af68c3 tempest-VolumesTestJSON-923346011 None] Lock "cinder-3c3108f6-e740-42eb-bf06-1c8029dbabe7-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:23 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 Sep 28 15:06:23 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:23 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9" returned: 0 in 0.415s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:23 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 is being set with open permissions: ugo+rw Sep 28 15:06:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:23 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 Sep 28 15:06:23 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:24 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9" returned: 0 in 0.371s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:24 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info Sep 28 15:06:24 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:24 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info" returned: 0 in 0.355s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:24 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info is being set with open permissions: ugo+rw Sep 28 15:06:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:24 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info Sep 28 15:06:24 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:24 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.info" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.050s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-250c88a3-4fe9-4a5c-b754-de6b1649b188 req-410dc3b9-c776-4670-b371-4bd0c953704a tempest-VolumesSnapshotsTestJSON-2033050784 None] Create snapshot completed successfully Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "cinder-c20a5609-58db-45f8-93f4-235e240dd7d9-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-c20a5609-58db-45f8-93f4-235e240dd7d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "cinder-quobyte-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-quobyte-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "cinder-quobyte-c20a5609-58db-45f8-93f4-235e240dd7d9" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-quobyte-c20a5609-58db-45f8-93f4-235e240dd7d9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Deleting offline snapshot c20a5609-58db-45f8-93f4-235e240dd7d9 of volume 5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] snapshot_file for this snap is: volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ed2b3-7a90-4c67-a273-29219c6df33c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:26 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 Sep 28 15:06:26 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9" returned: 0 in 0.513s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a184e81e-9c93-47d8-8fa2-248f5bb08851]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 Sep 28 15:06:27 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" returned: 0 in 0.484s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 Sep 28 15:06:27 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9" returned: 0 in 0.542s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9 Sep 28 15:06:27 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5.c20a5609-58db-45f8-93f4-235e240dd7d9" returned: 0 in 0.353s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-quobyte-c20a5609-58db-45f8-93f4-235e240dd7d9" released by "_delete_snapshot" :: held 2.069s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-quobyte-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" released by "delete_snapshot" :: held 2.101s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:28 devstack cinder-volume[87124]: WARNING cinder.quota [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:28 devstack cinder-volume[87124]: DEBUG cinder.quota [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Created reservations ['270c2d9d-0fc2-492e-ac26-2ef80a8470c2', '0dad8a6d-8182-42e3-801e-6d51b63476c1', '1481ffb5-586a-40f8-9a55-44207002a89e', 'ba6b12cf-564b-411c-8792-0ff63dea707d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Delete snapshot completed successfully. Sep 28 15:06:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-fc44892b-21d4-4521-b956-49264dfa232d req-2c9b4999-3e64-47aa-b482-017b0d72a7df tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-c20a5609-58db-45f8-93f4-235e240dd7d9-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "cinder-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "cinder-quobyte-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-quobyte-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f75ce-8bec-4cc7-8aad-008e66125eb3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:30 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 Sep 28 15:06:30 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:30 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" returned: 0 in 0.516s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:30 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5 Sep 28 15:06:30 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:30 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" returned: 0 in 0.333s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-quobyte-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5" released by "delete_volume" :: held 0.959s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG cinder.quota [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Created reservations ['800a77ae-556c-4f10-b632-a839b2a609d1', 'e1d3087c-ec76-46c3-b1f9-ede0354ff357', 'ab0eb49c-f394-4205-83c0-00963a1e3a25', '5a475a3e-5f8e-489f-9292-9f039f9cf312'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:31 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Flow 'volume_create_manager' (1b2f5283-8196-4d29-bc89-62ecf5928d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f194fb-4649-4b5b-9d9b-c687b486587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f194fb-4649-4b5b-9d9b-c687b486587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-429454170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb3b85c-9d3b-4280-abcb-a891ea7bf202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f93628c379406f8385253ac23dd3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:31Z,use_quota=True,user_id='717059f64387410b93cef963d3edae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4305d3-c757-4fea-8739-c811b6e90a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4305d3-c757-4fea-8739-c811b6e90a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377f73c3-6a77-41a6-b686-6956c497e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377f73c3-6a77-41a6-b686-6956c497e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb3b85c-9d3b-4280-abcb-a891ea7bf202', 'volume_name': 'volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f46a26d-548a-40ce-a965-cbafcb624092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f46a26d-548a-40ce-a965-cbafcb624092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470489fc-6a59-488f-8a91-76fed0d030b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Volume bbb3b85c-9d3b-4280-abcb-a891ea7bf202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202', 'volume_size': 1} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-429454170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb3b85c-9d3b-4280-abcb-a891ea7bf202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f93628c379406f8385253ac23dd3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:31Z,use_quota=True,user_id='717059f64387410b93cef963d3edae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Creating volume bbb3b85c-9d3b-4280-abcb-a891ea7bf202 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:31 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 1073741824 Sep 28 15:06:31 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:31 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.manager [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Deleted volume successfully. Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-cd8b6221-f55d-4aa0-ab6a-996df14f185e req-8670d690-8ebd-483e-8b9a-bb1021a3fff2 tempest-VolumesSnapshotsTestJSON-2033050784 None] Lock "cinder-5065dc8e-9bd2-42fa-9a66-f4eab82f64c5-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Flow 'volume_create_manager' (efaf4253-2b36-4a22-865e-8b9dde5187d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf6c39d-86f4-44f7-8bd5-eaeb783c0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf6c39d-86f4-44f7-8bd5-eaeb783c0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1322081219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f2d5ae22647b8bbe03612d5539389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:32Z,use_quota=True,user_id='e3f08e0b7f2f43a8ab467bcfa28ee271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a15d09-f238-4624-b7ea-784f1c5c7700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a15d09-f238-4624-b7ea-784f1c5c7700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63623764-4665-4dd9-95c6-10574f393cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63623764-4665-4dd9-95c6-10574f393cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b', 'volume_name': 'volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153d156c-6540-4ce6-924b-042b0d0767e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153d156c-6540-4ce6-924b-042b0d0767e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8f86b5-0449-42fa-b3d7-6f43cf148fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Volume fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b', 'volume_size': 1} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:32 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 1073741824" returned: 0 in 0.785s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:32 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 Sep 28 15:06:32 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-560d45f8-fd80-4b71-ab36-3a7f8084c3d1 tempest-GroupSnapshotsTest-1477347644 None] Group tempest-GroupSnapshotsTest-Group-1215630699: creating Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-560d45f8-fd80-4b71-ab36-3a7f8084c3d1 tempest-GroupSnapshotsTest-1477347644 None] Group tempest-GroupSnapshotsTest-Group-1215630699: created successfully Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-560d45f8-fd80-4b71-ab36-3a7f8084c3d1 tempest-GroupSnapshotsTest-1477347644 None] Create group completed successfully. Sep 28 15:06:32 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202" returned: 0 in 0.434s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1322081219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f2d5ae22647b8bbe03612d5539389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:32Z,use_quota=True,user_id='e3f08e0b7f2f43a8ab467bcfa28ee271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Creating volume fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:32 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b 1073741824 Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470489fc-6a59-488f-8a91-76fed0d030b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:32 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5533b3-a801-4451-8b3d-b58af9524d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Volume volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 (bbb3b85c-9d3b-4280-abcb-a891ea7bf202): created successfully Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5533b3-a801-4451-8b3d-b58af9524d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Flow 'volume_create_manager' (1b2f5283-8196-4d29-bc89-62ecf5928d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-409bf4a6-ea3a-4fac-8da8-88ca2ac28c66 tempest-VolumesServicesTestJSON-62086227 None] Created volume successfully. Sep 28 15:06:33 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b 1073741824" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:33 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b Sep 28 15:06:33 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:33 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b" returned: 0 in 0.405s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8f86b5-0449-42fa-b3d7-6f43cf148fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27a8ac1-ddd4-48b3-8a74-54fae9664af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Volume volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b (fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b): created successfully Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27a8ac1-ddd4-48b3-8a74-54fae9664af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Flow 'volume_create_manager' (efaf4253-2b36-4a22-865e-8b9dde5187d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5c5330fd-9b92-471e-84f4-bb839d30c528 tempest-VolumesListAdminTestJSON-1443862302 None] Created volume successfully. Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Acquiring lock "cinder-bbb3b85c-9d3b-4280-abcb-a891ea7bf202-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Lock "cinder-bbb3b85c-9d3b-4280-abcb-a891ea7bf202-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Acquiring lock "cinder-quobyte-bbb3b85c-9d3b-4280-abcb-a891ea7bf202" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Lock "cinder-quobyte-bbb3b85c-9d3b-4280-abcb-a891ea7bf202" acquired by "delete_volume" :: waited 0.060s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (47b8157b-f09e-406e-9cf9-766b869dbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb3cd8e-17b4-49fb-9f40-da5569c79e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2150aa67-a949-4186-8d5f-0d490ec19d30]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb3cd8e-17b4-49fb-9f40-da5569c79e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271076720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eff1711-f22a-406a-b927-f9a6bd765fca,host='devstack@QuobyteHD#QuobyteHD',id=01558034-cbfd-40c0-b625-0409762934e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:34Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eab32e9-435c-4186-8b7b-80088bd580d3),volume_type_id=8eab32e9-435c-4186-8b7b-80088bd580d3)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf96242-a7bb-4791-9d95-c499f73f675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf96242-a7bb-4791-9d95-c499f73f675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18407baa-0663-4a7d-8b8b-6bb00705719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18407baa-0663-4a7d-8b8b-6bb00705719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01558034-cbfd-40c0-b625-0409762934e5', 'volume_name': 'volume-01558034-cbfd-40c0-b625-0409762934e5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24ea04c-8534-4f67-a19a-2c1061ca1fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24ea04c-8534-4f67-a19a-2c1061ca1fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0bdd65-f685-4298-ac13-db2192bf436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:34 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Volume 01558034-cbfd-40c0-b625-0409762934e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01558034-cbfd-40c0-b625-0409762934e5', 'volume_size': 1} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3eff1711-f22a-406a-b927-f9a6bd765fca,created_at=2026-09-28T13:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271076720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eff1711-f22a-406a-b927-f9a6bd765fca,host='devstack@QuobyteHD#QuobyteHD',id=01558034-cbfd-40c0-b625-0409762934e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:34Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eab32e9-435c-4186-8b7b-80088bd580d3),volume_type_id=8eab32e9-435c-4186-8b7b-80088bd580d3)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Creating volume 01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:34 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:34 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 Sep 28 15:06:34 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:34 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 1073741824 Sep 28 15:06:34 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:34 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202" returned: 0 in 0.439s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:34 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202 Sep 28 15:06:34 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:35 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 1073741824" returned: 0 in 0.701s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:35 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bbb3b85c-9d3b-4280-abcb-a891ea7bf202" returned: 0 in 0.414s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Lock "cinder-quobyte-bbb3b85c-9d3b-4280-abcb-a891ea7bf202" released by "delete_volume" :: held 0.981s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:35 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 Sep 28 15:06:35 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Created reservations ['5d2b483f-25f9-4e5d-af02-010221553137', '2d0a96b4-b086-4579-9607-a01e0aa4b328', 'f136a31c-9902-4b22-9215-8a5a7600b99f', '321cef93-de8a-4e85-a5d5-717d8f6cd700'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:35 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:35 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:35 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5" returned: 0 in 0.565s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0bdd65-f685-4298-ac13-db2192bf436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01558034-cbfd-40c0-b625-0409762934e5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7b9cda-cfca-4453-bb5f-491fc937f305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:35 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Volume volume-01558034-cbfd-40c0-b625-0409762934e5 (01558034-cbfd-40c0-b625-0409762934e5): created successfully Sep 28 15:06:35 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7b9cda-cfca-4453-bb5f-491fc937f305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (47b8157b-f09e-406e-9cf9-766b869dbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.459s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Deleted volume successfully. Sep 28 15:06:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c91b1c20-0369-4af6-abf6-367ee317072e tempest-GroupSnapshotsTest-1477347644 None] Created volume successfully. Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Flow 'volume_create_manager' (755ac0d3-8b29-4d75-9e0f-6e82e587de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7258484-a82c-40af-aad8-f69b60d6ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-652d7fe1-fd83-4467-9363-58daeb90d7b9 tempest-VolumesServicesTestJSON-62086227 None] Lock "cinder-bbb3b85c-9d3b-4280-abcb-a891ea7bf202-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7258484-a82c-40af-aad8-f69b60d6ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1583721543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3cd556-7f4d-4e6b-9297-e59e36145604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f2d5ae22647b8bbe03612d5539389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:36Z,use_quota=True,user_id='e3f08e0b7f2f43a8ab467bcfa28ee271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b806fe2c-b7af-4a07-850a-1069712d66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b806fe2c-b7af-4a07-850a-1069712d66ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bfafb6-4128-409d-8978-274a3e57da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bfafb6-4128-409d-8978-274a3e57da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3cd556-7f4d-4e6b-9297-e59e36145604', 'volume_name': 'volume-4d3cd556-7f4d-4e6b-9297-e59e36145604', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59935b17-4930-470e-a41e-014904ce0f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59935b17-4930-470e-a41e-014904ce0f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b320fde5-820a-49df-b6be-38183e8112f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:36 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Volume 4d3cd556-7f4d-4e6b-9297-e59e36145604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3cd556-7f4d-4e6b-9297-e59e36145604', 'volume_size': 1} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1583721543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3cd556-7f4d-4e6b-9297-e59e36145604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f2d5ae22647b8bbe03612d5539389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:36Z,use_quota=True,user_id='e3f08e0b7f2f43a8ab467bcfa28ee271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Creating volume 4d3cd556-7f4d-4e6b-9297-e59e36145604 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:36 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:36 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 1073741824 Sep 28 15:06:36 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:36 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 1073741824" returned: 0 in 0.632s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:37 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 Sep 28 15:06:37 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:37 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:37 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:37 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604" returned: 0 in 0.524s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b320fde5-820a-49df-b6be-38183e8112f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3cd556-7f4d-4e6b-9297-e59e36145604', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8135f6-d863-46ef-a675-c34bc598f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:37 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Volume volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 (4d3cd556-7f4d-4e6b-9297-e59e36145604): created successfully Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8135f6-d863-46ef-a675-c34bc598f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Flow 'volume_create_manager' (755ac0d3-8b29-4d75-9e0f-6e82e587de48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] GroupSnapshot 9d49ebcc-477f-47f1-8c2c-93914cd284df: creating. Sep 28 15:06:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7cb0b212-8662-4079-bc48-662b5ed6b9ed tempest-VolumesListAdminTestJSON-1443862302 None] Created volume successfully. Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Group snapshot 9d49ebcc-477f-47f1-8c2c-93914cd284df: creating. {{(pid=87124) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Creating offline snapshot ce0d4132-73be-4afd-a641-4639c634f1e7 of volume 01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:37 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1964859c-8243-4a21-8ee3-156a75ffe2bc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:06:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:06:37 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 Sep 28 15:06:37 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:38 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5" returned: 0 in 0.495s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:38 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 1G Sep 28 15:06:38 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:38 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 1G" returned: 0 in 0.638s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01558034-cbfd-40c0-b625-0409762934e5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:38 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01558034-cbfd-40c0-b625-0409762934e5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 Sep 28 15:06:38 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:39 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Flow 'volume_create_manager' (3fadd323-b7d7-46f7-bee7-0d27b229ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7eb26c-2a42-4707-9b6d-cb4d3b18cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01558034-cbfd-40c0-b625-0409762934e5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7" returned: 0 in 0.509s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:39 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:39 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 Sep 28 15:06:39 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7eb26c-2a42-4707-9b6d-cb4d3b18cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-925039836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03e6c2b-3980-40bf-b03e-b25db551ab0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f2d5ae22647b8bbe03612d5539389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:39Z,use_quota=True,user_id='e3f08e0b7f2f43a8ab467bcfa28ee271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff5e4e9-62b6-45c3-a40f-cce57ec6f5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff5e4e9-62b6-45c3-a40f-cce57ec6f5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad380cc-9e85-44cb-939b-19472fd84e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad380cc-9e85-44cb-939b-19472fd84e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03e6c2b-3980-40bf-b03e-b25db551ab0b', 'volume_name': 'volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5311e0db-6ed0-4d02-a786-968f23e1b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5311e0db-6ed0-4d02-a786-968f23e1b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3593ce02-3d46-43bb-96bc-54657c8de69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:39 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Volume f03e6c2b-3980-40bf-b03e-b25db551ab0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b', 'volume_size': 1} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:39 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7" returned: 0 in 0.446s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:39 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info Sep 28 15:06:39 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6c8ae4c5-ee8a-4339-baf1-38487caa347b tempest-GroupsV314Test-1525888706 None] Group tempest-GroupsV314Test-Group-1716272204: creating Sep 28 15:06:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6c8ae4c5-ee8a-4339-baf1-38487caa347b tempest-GroupsV314Test-1525888706 None] Group tempest-GroupsV314Test-Group-1716272204: created successfully Sep 28 15:06:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6c8ae4c5-ee8a-4339-baf1-38487caa347b tempest-GroupsV314Test-1525888706 None] Create group completed successfully. Sep 28 15:06:40 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:40 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:40 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info Sep 28 15:06:40 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:40 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.info" returned: 0 in 0.342s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-925039836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03e6c2b-3980-40bf-b03e-b25db551ab0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f2d5ae22647b8bbe03612d5539389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:39Z,use_quota=True,user_id='e3f08e0b7f2f43a8ab467bcfa28ee271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Creating volume f03e6c2b-3980-40bf-b03e-b25db551ab0b {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:40 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:40 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b 1073741824 Sep 28 15:06:40 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7727b5f8-82e7-4d0b-9d67-caa4a5007bb7 tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 9d49ebcc-477f-47f1-8c2c-93914cd284df: created successfully Sep 28 15:06:41 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b 1073741824" returned: 0 in 0.660s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:41 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b Sep 28 15:06:41 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:41 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3593ce02-3d46-43bb-96bc-54657c8de69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4fc3cd-df45-4f5c-8bcd-a2b9c0fa484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Volume volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b (f03e6c2b-3980-40bf-b03e-b25db551ab0b): created successfully Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4fc3cd-df45-4f5c-8bcd-a2b9c0fa484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Flow 'volume_create_manager' (3fadd323-b7d7-46f7-bee7-0d27b229ce37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2d7de1e3-cfd3-43a0-a6c9-32a5b47e9a87 tempest-VolumesListAdminTestJSON-1443862302 None] Created volume successfully. Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-ce0d4132-73be-4afd-a641-4639c634f1e7-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-ce0d4132-73be-4afd-a641-4639c634f1e7-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Creating volume 4e7bdb4d-d589-4f29-90b3-6614edf5f5bd from snapshot ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Flow 'volume_create_manager' (e8b6fb1c-7e96-4d8e-bf3b-2be678f29507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a900f644-2742-4668-a073-0253fa9a9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" acquired by "_copy_volume_from_snapshot" :: waited 0.081s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] snapshot: ce0d4132-73be-4afd-a641-4639c634f1e7, volume: 4e7bdb4d-d589-4f29-90b3-6614edf5f5bd, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a900f644-2742-4668-a073-0253fa9a9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1661437347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e52a7fa0-e905-4f9a-a792-5849499e94f1,host='devstack@QuobyteHD#QuobyteHD',id=52fa5a7a-0f8d-4fa0-94a2-4fdea347b979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b342c038054a451ebb6ba131ee8ea773',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:42Z,use_quota=True,user_id='1071f739f977435c8fff962b3a45d3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a0e88f-9bab-46f1-9d8f-0377d13c2535),volume_type_id=d7a0e88f-9bab-46f1-9d8f-0377d13c2535)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b3942-4286-4d2e-b641-2c7af53b551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b3942-4286-4d2e-b641-2c7af53b551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e463f423-342c-4850-884f-f88e23630406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e463f423-342c-4850-884f-f88e23630406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fa5a7a-0f8d-4fa0-94a2-4fdea347b979', 'volume_name': 'volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bda490-d8a0-4eaa-bf65-5ec232869ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bda490-d8a0-4eaa-bf65-5ec232869ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1629b875-428a-49c7-8234-1d59592f7c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Volume 52fa5a7a-0f8d-4fa0-94a2-4fdea347b979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979', 'volume_size': 1} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c13c4-7822-433a-b271-244c466c5d82]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:42 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 Sep 28 15:06:42 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:43 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7" returned: 0 in 0.547s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01558034-cbfd-40c0-b625-0409762934e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee1220-f554-4a1d-8f68-f8bf6bddaefd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:43 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 Sep 28 15:06:43 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:43 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5" returned: 0 in 0.500s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:06:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:43 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd Sep 28 15:06:43 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Flow 'volume_create_manager' (c8283075-24aa-403f-b9e7-ef5895f5427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c3c640-1927-4b95-af48-e5be7f663165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c3c640-1927-4b95-af48-e5be7f663165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222fbd61-3cb5-4227-8235-45d8e4c4f9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45660e0f92244d5cac0de8a25561954a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:44Z,use_quota=True,user_id='fe347e5d2ff24d18bf58b49e1ba56169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec10276e-e30a-4d4b-8b13-c30d449533f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec10276e-e30a-4d4b-8b13-c30d449533f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3e4303-33c1-409a-bea7-19e69d9bfd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3e4303-33c1-409a-bea7-19e69d9bfd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222fbd61-3cb5-4227-8235-45d8e4c4f9dd', 'volume_name': 'volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e5e46e-0e60-4870-a0bc-6c7f4d0ddd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e5e46e-0e60-4870-a0bc-6c7f4d0ddd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015be0f4-924e-4159-a983-ae53b1e535ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:44 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Volume 222fbd61-3cb5-4227-8235-45d8e4c4f9dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd', 'volume_size': 1} Sep 28 15:06:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:DELETE=11,cinder:UPDATE=155,cinder:SELECT=133,cinder:INSERT=40 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=116,cinder:UPDATE=169,cinder:DELETE=17,cinder:INSERT=34 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Flow 'volume_create_manager' (06fbf849-8177-4a81-8dce-d935bff43fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c44c6b1-ae90-4f72-acf1-7193a5853f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c44c6b1-ae90-4f72-acf1-7193a5853f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-559420316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f395d4-724c-4bb4-849d-c35553e5915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f5797a26d643ab81455424bac35ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:48Z,use_quota=True,user_id='e048440c3ef24692b1b0b5a43a7e5482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69ddf9ce-de6d-4c63-b525-ea5760a44902),volume_type_id=69ddf9ce-de6d-4c63-b525-ea5760a44902)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd8d524-22f5-4016-aaed-a148d59014b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd8d524-22f5-4016-aaed-a148d59014b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f3c76-dd3b-4d1b-a36d-100ce9da88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f3c76-dd3b-4d1b-a36d-100ce9da88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f395d4-724c-4bb4-849d-c35553e5915d', 'volume_name': 'volume-64f395d4-724c-4bb4-849d-c35553e5915d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ae2283-7a7a-450e-ba89-88f14d98b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ae2283-7a7a-450e-ba89-88f14d98b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b00ede3-39c6-4c4e-ab01-d619c9e923fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Volume 64f395d4-724c-4bb4-849d-c35553e5915d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f395d4-724c-4bb4-849d-c35553e5915d', 'volume_size': 1} Sep 28 15:06:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:51 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" returned: 0 in 7.602s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:51 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Converted 1024.00 MB image at 134.68 MB/s Sep 28 15:06:51 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:51 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd Sep 28 15:06:51 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" returned: 0 in 0.305s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" released by "_copy_volume_from_snapshot" :: held 9.178s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-ce0d4132-73be-4afd-a641-4639c634f1e7-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" released by "_create_volume_from_snapshot" :: held 9.323s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.380s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.139s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e52a7fa0-e905-4f9a-a792-5849499e94f1,created_at=2026-09-28T13:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1661437347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e52a7fa0-e905-4f9a-a792-5849499e94f1,host='devstack@QuobyteHD#QuobyteHD',id=52fa5a7a-0f8d-4fa0-94a2-4fdea347b979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b342c038054a451ebb6ba131ee8ea773',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:42Z,use_quota=True,user_id='1071f739f977435c8fff962b3a45d3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a0e88f-9bab-46f1-9d8f-0377d13c2535),volume_type_id=d7a0e88f-9bab-46f1-9d8f-0377d13c2535)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Creating volume 52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:51 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:51 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 1073741824 Sep 28 15:06:51 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d0f70df7-5d06-4b43-908c-4aa9ac17aed6 tempest-GroupSnapshotsTest-1477347644 None] Create group from source-snapshot-9d49ebcc-477f-47f1-8c2c-93914cd284df completed successfully. Sep 28 15:06:52 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 1073741824" returned: 0 in 0.462s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 Sep 28 15:06:52 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" returned: 0 in 0.244s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.885s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222fbd61-3cb5-4227-8235-45d8e4c4f9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45660e0f92244d5cac0de8a25561954a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:44Z,use_quota=True,user_id='fe347e5d2ff24d18bf58b49e1ba56169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Creating volume 222fbd61-3cb5-4227-8235-45d8e4c4f9dd {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:52 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd 1073741824 Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1629b875-428a-49c7-8234-1d59592f7c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:52 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c6489c-2055-4815-9bae-4841829f6c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Volume volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 (52fa5a7a-0f8d-4fa0-94a2-4fdea347b979): created successfully Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c6489c-2055-4815-9bae-4841829f6c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Flow 'volume_create_manager' (e8b6fb1c-7e96-4d8e-bf3b-2be678f29507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dd513148-ce53-4a90-9c30-9cb3a5b3af97 tempest-GroupsV314Test-1525888706 None] Created volume successfully. Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6177560-4381-4ea5-94b2-dfe968db834e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd Sep 28 15:06:52 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd 1073741824" returned: 0 in 0.523s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd Sep 28 15:06:52 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" returned: 0 in 0.414s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd Sep 28 15:06:53 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd" returned: 0 in 0.274s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.672s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-559420316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f395d4-724c-4bb4-849d-c35553e5915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f5797a26d643ab81455424bac35ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:48Z,use_quota=True,user_id='e048440c3ef24692b1b0b5a43a7e5482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69ddf9ce-de6d-4c63-b525-ea5760a44902),volume_type_id=69ddf9ce-de6d-4c63-b525-ea5760a44902)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Creating volume 64f395d4-724c-4bb4-849d-c35553e5915d {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:53 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015be0f4-924e-4159-a983-ae53b1e535ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:53 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d 1073741824 Sep 28 15:06:53 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e752723-2c22-41e2-9ec0-0898a01fd49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Volume volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd (222fbd61-3cb5-4227-8235-45d8e4c4f9dd): created successfully Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e752723-2c22-41e2-9ec0-0898a01fd49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Flow 'volume_create_manager' (c8283075-24aa-403f-b9e7-ef5895f5427f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-95921d25-dc49-42db-93d9-3d7b99931714 tempest-VolumesListAdminTestJSON-433928928 None] Created volume successfully. Sep 28 15:06:53 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-4e7bdb4d-d589-4f29-90b3-6614edf5f5bd" released by "delete_volume" :: held 0.874s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['0bcf9b26-7afa-446e-b3c2-f3c282fbbde0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:53 devstack cinder-volume[87124]: WARNING cinder.quota [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-33532524 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-33532524, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:53 devstack cinder-volume[87124]: WARNING cinder.quota [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-33532524 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-33532524, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['a13f92fe-42b7-4507-aa16-60d6c198c6a8', '8fcc9d9c-0dfd-438d-a3ce-ac474824e344', '96a52bc6-5578-476b-b317-3f02a8aea5a7', '923fb581-1482-4bfe-961d-c8bb15606008'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:53 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d 1073741824" returned: 0 in 0.755s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Acquiring lock "cinder-222fbd61-3cb5-4227-8235-45d8e4c4f9dd-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Lock "cinder-222fbd61-3cb5-4227-8235-45d8e4c4f9dd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Acquiring lock "cinder-quobyte-222fbd61-3cb5-4227-8235-45d8e4c4f9dd" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:54 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d Sep 28 15:06:54 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Lock "cinder-quobyte-222fbd61-3cb5-4227-8235-45d8e4c4f9dd" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[415727cf-7596-489b-8b8d-72198818ab2e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 9d49ebcc-477f-47f1-8c2c-93914cd284df: deleting Sep 28 15:06:54 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.441s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d746eea1-d09b-48c0-a253-f446f81435ea tempest-GroupSnapshotsTest-1477347644 None] Delete group completed successfully. Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "cinder-f03e6c2b-3980-40bf-b03e-b25db551ab0b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 9d49ebcc-477f-47f1-8c2c-93914cd284df: deleting {{(pid=87124) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-f03e6c2b-3980-40bf-b03e-b25db551ab0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-01558034-cbfd-40c0-b625-0409762934e5" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:54 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd Sep 28 15:06:54 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-01558034-cbfd-40c0-b625-0409762934e5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-ce0d4132-73be-4afd-a641-4639c634f1e7" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "cinder-quobyte-f03e6c2b-3980-40bf-b03e-b25db551ab0b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-ce0d4132-73be-4afd-a641-4639c634f1e7" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Deleting offline snapshot ce0d4132-73be-4afd-a641-4639c634f1e7 of volume 01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] snapshot_file for this snap is: volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210bf21-61be-4d66-ac0e-36d66d8c7352]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-quobyte-f03e6c2b-3980-40bf-b03e-b25db551ab0b" acquired by "delete_volume" :: waited 0.068s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:54 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[219633f6-73c4-4c09-9696-3c8665e09370]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d" returned: 0 in 0.522s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.831s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:54 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Cloning volume 52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 to volume 2b142bce-4bc7-4c76-ab36-120697c9b93d Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b00ede3-39c6-4c4e-ab01-d619c9e923fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f395d4-724c-4bb4-849d-c35553e5915d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ced279c-0837-478e-a2ff-a141080572fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 Sep 28 15:06:54 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Volume volume-64f395d4-724c-4bb4-849d-c35553e5915d (64f395d4-724c-4bb4-849d-c35553e5915d): created successfully Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ced279c-0837-478e-a2ff-a141080572fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Flow 'volume_create_manager' (06fbf849-8177-4a81-8dce-d935bff43fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Creating offline snapshot 8ff9d125-f1a0-4865-a64c-b532bcba0ee1 of volume 52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-581556d7-4fec-4aa9-99ce-b1cd82211965 tempest-VolumeTypesAccessTest-2107845975 None] Created volume successfully. Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cb86a7-e15f-4da8-9d6d-2412e7e52fb0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b Sep 28 15:06:54 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd" returned: 0 in 0.582s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd Sep 28 15:06:54 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 Sep 28 15:06:54 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7" returned: 0 in 0.483s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01558034-cbfd-40c0-b625-0409762934e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[da149e4f-8749-484d-b837-b3779ec43d1a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b" returned: 0 in 0.504s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-222fbd61-3cb5-4227-8235-45d8e4c4f9dd" returned: 0 in 0.315s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b Sep 28 15:06:55 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Lock "cinder-quobyte-222fbd61-3cb5-4227-8235-45d8e4c4f9dd" released by "delete_volume" :: held 0.967s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:55 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 Sep 28 15:06:55 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Created reservations ['20d7dd40-02b0-407b-bd32-740ac8a50b61', '6c436b91-7637-4ba5-82b3-d4fe1b69a3f3', 'ead4e6d0-1cd9-42a3-8e44-d481e048fe73', '5555f2b2-4114-48b5-a4b0-c864932d09d0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" returned: 0 in 0.455s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 1G Sep 28 15:06:55 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:55 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f03e6c2b-3980-40bf-b03e-b25db551ab0b" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-quobyte-f03e6c2b-3980-40bf-b03e-b25db551ab0b" released by "delete_volume" :: held 0.945s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Created reservations ['c326c61d-a773-4399-963e-deabb893f02e', 'a1fe73e5-ecce-4f60-8c62-346203368e2e', 'ebb1d547-4340-42b1-853b-3a922f721939', '5fd2c5b4-e602-46f1-8b39-25c74a1d76af'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:55 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.419s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Deleted volume successfully. Sep 28 15:06:55 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-22250f88-4f86-4599-b930-1e314a49f56f tempest-VolumesListAdminTestJSON-433928928 None] Lock "cinder-222fbd61-3cb5-4227-8235-45d8e4c4f9dd-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5" returned: 0 in 0.784s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 Sep 28 15:06:55 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 1G" returned: 0 in 0.717s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Acquiring lock "cinder-64f395d4-724c-4bb4-849d-c35553e5915d-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:55 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 Sep 28 15:06:55 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Lock "cinder-64f395d4-724c-4bb4-849d-c35553e5915d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Acquiring lock "cinder-quobyte-64f395d4-724c-4bb4-849d-c35553e5915d" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Lock "cinder-quobyte-64f395d4-724c-4bb4-849d-c35553e5915d" acquired by "delete_volume" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:56 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.434s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c40fad-3be7-4110-b297-ddccce1a3c1c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Deleted volume successfully. Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cb978b1c-0579-4269-99c5-1f4503ae247d tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-f03e6c2b-3980-40bf-b03e-b25db551ab0b-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:56 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d Sep 28 15:06:56 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7" returned: 0 in 0.509s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7 Sep 28 15:06:56 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1" returned: 0 in 0.476s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 Sep 28 15:06:56 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d" returned: 0 in 0.513s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5.ce0d4132-73be-4afd-a641-4639c634f1e7" returned: 0 in 0.362s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d Sep 28 15:06:56 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-ce0d4132-73be-4afd-a641-4639c634f1e7" released by "_delete_snapshot" :: held 2.304s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-01558034-cbfd-40c0-b625-0409762934e5" released by "delete_snapshot" :: held 2.364s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "cinder-4d3cd556-7f4d-4e6b-9297-e59e36145604-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:56 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info Sep 28 15:06:56 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-4d3cd556-7f4d-4e6b-9297-e59e36145604-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:56 devstack cinder-volume[87124]: WARNING cinder.quota [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-33532524 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-33532524, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "cinder-quobyte-4d3cd556-7f4d-4e6b-9297-e59e36145604" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['19d77179-357a-4e20-affe-ba896588cbe1', '2115d2ff-46bd-4fc2-8bfb-52c086df01d8', 'e5ee70f6-32ff-4f5a-bfd0-0dfc2f94a24e', '53ea8da4-bad8-4216-8340-f5f4350febc0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-quobyte-4d3cd556-7f4d-4e6b-9297-e59e36145604" acquired by "delete_volume" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-64f395d4-724c-4bb4-849d-c35553e5915d" returned: 0 in 0.482s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d97c417-ce27-4268-895a-6821963a08a3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Lock "cinder-quobyte-64f395d4-724c-4bb4-849d-c35553e5915d" released by "delete_volume" :: held 1.083s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:57 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info" returned: 0 in 0.376s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack cinder-volume[87124]: WARNING cinder.quota [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-442266013 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-442266013, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:57 devstack cinder-volume[87124]: WARNING cinder.quota [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-442266013 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-442266013, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:57 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info Sep 28 15:06:57 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-828e8728-db9c-47bf-b039-3de69c235133 tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 9d49ebcc-477f-47f1-8c2c-93914cd284df: deleted successfully Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Created reservations ['738a2a3d-ba7a-41a1-8f70-405f0aeebbbc', '44283c88-64fa-4817-acd9-3fdbde4e0fd0', '75ba7d99-f066-43b2-94aa-8a3558956185', 'c975b86b-6c44-4ef1-8ae5-816339f6afa2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:57 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 Sep 28 15:06:57 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:57 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.info" returned: 0 in 0.318s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Acquiring lock "cinder-quobyte-2b142bce-4bc7-4c76-ab36-120697c9b93d" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-2b142bce-4bc7-4c76-ab36-120697c9b93d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] snapshot: 8ff9d125-f1a0-4865-a64c-b532bcba0ee1, volume: 2b142bce-4bc7-4c76-ab36-120697c9b93d, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:57 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604" returned: 0 in 0.494s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54088d5-27fd-4965-a2b9-7b5c54b6ebad]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604 Sep 28 15:06:57 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.296s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Deleted volume successfully. Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fc70a928-e12b-4736-8826-3c42502019ef tempest-VolumeTypesAccessTest-2107845975 None] Lock "cinder-64f395d4-724c-4bb4-849d-c35553e5915d-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:57 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 Sep 28 15:06:57 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4d3cd556-7f4d-4e6b-9297-e59e36145604" returned: 0 in 0.361s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-quobyte-4d3cd556-7f4d-4e6b-9297-e59e36145604" released by "delete_volume" :: held 0.939s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Created reservations ['921805aa-d9d0-48af-9579-fb9cc30402d9', 'a5b6e184-5eab-43f9-884a-f9e224cf3838', 'ab1c1569-f11c-4287-86d0-abd969e8ab6a', '3857d160-ac94-4eae-a4cb-d81d06e8ae37'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:58 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1" returned: 0 in 0.562s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:58 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:06:58 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c9f309-9aef-49d7-9e81-a26c2f8734af]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-01558034-cbfd-40c0-b625-0409762934e5" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-01558034-cbfd-40c0-b625-0409762934e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c9d804-1f51-4225-8717-a89db4a8fda8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 Sep 28 15:06:58 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.380s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Deleted volume successfully. Sep 28 15:06:58 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 Sep 28 15:06:58 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-43745c4e-1a06-4468-9079-15388f861cad tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-4d3cd556-7f4d-4e6b-9297-e59e36145604-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:58 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" returned: 0 in 0.602s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d Sep 28 15:06:58 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5" returned: 0 in 0.571s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5 Sep 28 15:06:58 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:59 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-01558034-cbfd-40c0-b625-0409762934e5" returned: 0 in 0.426s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "cinder-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-01558034-cbfd-40c0-b625-0409762934e5" released by "delete_volume" :: held 1.121s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "cinder-quobyte-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-quobyte-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b" acquired by "delete_volume" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c11c29e-7761-468e-8b7d-5f9460aee20d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['abd6fa56-832c-4d52-a0fb-8a853a9375fb'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:59 devstack cinder-volume[87124]: WARNING cinder.db.api [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-33532524'] Sep 28 15:06:59 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['fd00558d-fcdf-46db-8b84-37bcea896d8c', '83ec710b-a358-4d05-8df5-f0cdc14c1935', 'b9181180-51d0-482c-a9bd-5696c06fe0ac', '33156497-dc1a-46f4-84e6-3dfd2675b0d1'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:59 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b Sep 28 15:06:59 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:00 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:00 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:00 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b" returned: 0 in 1.152s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:00 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b Sep 28 15:07:00 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:00 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.727s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:00 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cd599e2e-1436-4f48-b79f-2bd6d6dc341e tempest-GroupSnapshotsTest-1477347644 None] Delete group completed successfully. Sep 28 15:07:01 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b" returned: 0 in 0.575s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-quobyte-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b" released by "delete_volume" :: held 1.814s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Created reservations ['2b15320e-6173-420f-a1b6-aa5ed98f2573', '2d0550ac-5dc8-4c66-be2d-3a811aebf935', '22560c0c-eeb2-4e00-8422-c4e0eb5a0956', '249eaeda-d725-4135-ab5a-1939423f3201'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:01 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:01 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a83e2547-9f37-464e-a1ce-ec1cf0c6b947 tempest-GroupSnapshotsTest-1477347644 None] Group tempest-GroupSnapshotsTest-Group-159650037: creating Sep 28 15:07:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a83e2547-9f37-464e-a1ce-ec1cf0c6b947 tempest-GroupSnapshotsTest-1477347644 None] Group tempest-GroupSnapshotsTest-Group-159650037: created successfully Sep 28 15:07:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a83e2547-9f37-464e-a1ce-ec1cf0c6b947 tempest-GroupSnapshotsTest-1477347644 None] Create group completed successfully. Sep 28 15:07:02 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.824s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:02 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Deleted volume successfully. Sep 28 15:07:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5ec57453-e4c6-46b3-a79c-d2760c231e22 tempest-VolumesListAdminTestJSON-1443862302 None] Lock "cinder-fe9ccf0f-b9ac-4c0f-9fd9-ecb01d1cca9b-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (da4258f0-8e39-4d01-8280-143e75b5b05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f5b150-909a-426c-bab8-f19dd123ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f5b150-909a-426c-bab8-f19dd123ab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1344431773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0b4229-6467-4cc8-bcb5-ca1bc104bd43,host='devstack@QuobyteHD#QuobyteHD',id=c2c5cda6-b88b-4285-88be-fd54d2a1023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:05Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5213fed-0619-4512-8a1d-e1531f2e1cb8),volume_type_id=b5213fed-0619-4512-8a1d-e1531f2e1cb8)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf92e48e-8ff0-4ddb-9cb1-0d800edec51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf92e48e-8ff0-4ddb-9cb1-0d800edec51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86591131-ac4b-421a-9eb1-00fef9cff46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86591131-ac4b-421a-9eb1-00fef9cff46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c5cda6-b88b-4285-88be-fd54d2a1023f', 'volume_name': 'volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8dd6f1-c606-4316-a28a-e43b3aaaf7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8dd6f1-c606-4316-a28a-e43b3aaaf7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3889e72e-a8a8-4e5b-b51f-9c4019ba86d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:05 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Volume c2c5cda6-b88b-4285-88be-fd54d2a1023f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f', 'volume_size': 1} Sep 28 15:07:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:08 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d" returned: 0 in 9.997s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:08 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:07:08 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Converted 1024.00 MB image at 102.42 MB/s Sep 28 15:07:08 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:08 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d Sep 28 15:07:08 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:09 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d" returned: 0 in 0.292s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-2b142bce-4bc7-4c76-ab36-120697c9b93d" released by "_copy_volume_from_snapshot" :: held 11.583s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Acquiring lock "cinder-quobyte-8ff9d125-f1a0-4865-a64c-b532bcba0ee1" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-8ff9d125-f1a0-4865-a64c-b532bcba0ee1" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Deleting offline snapshot 8ff9d125-f1a0-4865-a64c-b532bcba0ee1 of volume 52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] snapshot_file for this snap is: volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eba903-6228-4d70-8f0f-9cacc58211a8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:09 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 Sep 28 15:07:09 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:09 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1" returned: 0 in 0.423s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2bd551-5dfe-4db1-8c3f-1b32db691092]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:09 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 Sep 28 15:07:09 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:10 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" returned: 0 in 0.634s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:10 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 Sep 28 15:07:10 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:10 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1" returned: 0 in 0.431s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:10 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1 Sep 28 15:07:10 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:11 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979.8ff9d125-f1a0-4865-a64c-b532bcba0ee1" returned: 0 in 0.317s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-8ff9d125-f1a0-4865-a64c-b532bcba0ee1" released by "_delete_snapshot" :: held 1.979s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.622s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.883s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f0b4229-6467-4cc8-bcb5-ca1bc104bd43,created_at=2026-09-28T13:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1344431773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0b4229-6467-4cc8-bcb5-ca1bc104bd43,host='devstack@QuobyteHD#QuobyteHD',id=c2c5cda6-b88b-4285-88be-fd54d2a1023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:05Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5213fed-0619-4512-8a1d-e1531f2e1cb8),volume_type_id=b5213fed-0619-4512-8a1d-e1531f2e1cb8)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Creating volume c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:11 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:11 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f 1073741824 Sep 28 15:07:11 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-050caa98-3ade-4d25-a81d-579fd9600cb1 tempest-GroupsV314Test-1525888706 None] Create group from source-group-e52a7fa0-e905-4f9a-a792-5849499e94f1 completed successfully. Sep 28 15:07:11 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f 1073741824" returned: 0 in 0.698s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:12 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f Sep 28 15:07:12 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Acquiring lock "cinder-quobyte-2b142bce-4bc7-4c76-ab36-120697c9b93d" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-2b142bce-4bc7-4c76-ab36-120697c9b93d" acquired by "delete_volume" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8eb76-8a99-4d2a-8b90-6d65b19a854c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:12 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f" returned: 0 in 0.574s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:12 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d Sep 28 15:07:12 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3889e72e-a8a8-4e5b-b51f-9c4019ba86d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa1fee6-a395-4877-90c7-faa843648887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:12 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Volume volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f (c2c5cda6-b88b-4285-88be-fd54d2a1023f): created successfully Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa1fee6-a395-4877-90c7-faa843648887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (da4258f0-8e39-4d01-8280-143e75b5b05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5f92e298-6ae4-43bf-a3f9-caa9796690f9 tempest-GroupSnapshotsTest-1477347644 None] Created volume successfully. Sep 28 15:07:12 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d" returned: 0 in 0.566s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:12 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d Sep 28 15:07:12 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:13 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2b142bce-4bc7-4c76-ab36-120697c9b93d" returned: 0 in 0.273s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-2b142bce-4bc7-4c76-ab36-120697c9b93d" released by "delete_volume" :: held 0.921s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Created reservations ['e4e89643-c4c5-4284-903a-8fa5e65f297b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:13 devstack cinder-volume[87124]: WARNING cinder.quota [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-451391492 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-451391492, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:13 devstack cinder-volume[87124]: WARNING cinder.quota [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-451391492 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-451391492, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Created reservations ['3cecb648-0e0b-422e-8193-6f51e70f5062', '74998d81-06e5-417b-87a6-b8ab61fbce37', '82dde1e1-75f8-4e9e-bb04-1764073ee174', 'c3f32d03-61e2-4c1d-9712-72ba76076c1b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:13 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:13 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.455s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c65352aa-7681-4f5a-a3ad-97881aeca912 tempest-GroupsV314Test-1525888706 None] Delete group completed successfully. Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Flow 'volume_create_manager' (98331d10-40a1-49ef-abd1-3fa463699fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6695d7eb-97b7-44b4-83db-0bccb11fc5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6695d7eb-97b7-44b4-83db-0bccb11fc5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-487550140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c074a3-1e9f-4c07-90ae-503d5a84e49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f3fba58d7c435290803dc5c27e74c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:14Z,use_quota=True,user_id='f7869e6c72ae4225ae0cb5266188757d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be21d0-0d11-4f34-933b-9f6dd8ac2a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be21d0-0d11-4f34-933b-9f6dd8ac2a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e6f774-c29a-4778-afa5-26449f9377f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e6f774-c29a-4778-afa5-26449f9377f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c074a3-1e9f-4c07-90ae-503d5a84e49c', 'volume_name': 'volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbde141b-ff51-41ca-8556-a69be7fc63b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbde141b-ff51-41ca-8556-a69be7fc63b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a4d1da-2ca6-4d4f-9a97-70750783fd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Volume e1c074a3-1e9f-4c07-90ae-503d5a84e49c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c', 'volume_size': 1} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-487550140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c074a3-1e9f-4c07-90ae-503d5a84e49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f3fba58d7c435290803dc5c27e74c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:14Z,use_quota=True,user_id='f7869e6c72ae4225ae0cb5266188757d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Creating volume e1c074a3-1e9f-4c07-90ae-503d5a84e49c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:14 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:14 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c 1073741824 Sep 28 15:07:14 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (c48da899-31a5-4b57-9a3b-2defc2a0f3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546c8f6-0c34-4a49-9bfd-eef18f7bc1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546c8f6-0c34-4a49-9bfd-eef18f7bc1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531314652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0b4229-6467-4cc8-bcb5-ca1bc104bd43,host='devstack@QuobyteHD#QuobyteHD',id=492ab0d8-cd9c-49b4-97fc-929147134f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:15Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5213fed-0619-4512-8a1d-e1531f2e1cb8),volume_type_id=b5213fed-0619-4512-8a1d-e1531f2e1cb8)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee291da4-215c-4e96-a5d1-c1c1e9a954d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee291da4-215c-4e96-a5d1-c1c1e9a954d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e673894a-942b-4123-80f3-2f0e38200689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e673894a-942b-4123-80f3-2f0e38200689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492ab0d8-cd9c-49b4-97fc-929147134f49', 'volume_name': 'volume-492ab0d8-cd9c-49b4-97fc-929147134f49', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672f4707-6f95-49b7-bc31-904ca746e650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672f4707-6f95-49b7-bc31-904ca746e650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19043d9d-b5a8-4756-a4a3-c063679a10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Volume 492ab0d8-cd9c-49b4-97fc-929147134f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492ab0d8-cd9c-49b4-97fc-929147134f49', 'volume_size': 1} Sep 28 15:07:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:15 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c 1073741824" returned: 0 in 0.704s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Acquiring lock "cinder-quobyte-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e74ce-1db8-4472-8bb0-ed9cc9547c91]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c Sep 28 15:07:15 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:15 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 Sep 28 15:07:15 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:15 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c" returned: 0 in 0.325s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f0b4229-6467-4cc8-bcb5-ca1bc104bd43,created_at=2026-09-28T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531314652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0b4229-6467-4cc8-bcb5-ca1bc104bd43,host='devstack@QuobyteHD#QuobyteHD',id=492ab0d8-cd9c-49b4-97fc-929147134f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:15Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5213fed-0619-4512-8a1d-e1531f2e1cb8),volume_type_id=b5213fed-0619-4512-8a1d-e1531f2e1cb8)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Creating volume 492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:15 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 1073741824 Sep 28 15:07:15 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a4d1da-2ca6-4d4f-9a97-70750783fd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c201a40-28b5-4ba0-9e93-04b55694b406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:15 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Volume volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c (e1c074a3-1e9f-4c07-90ae-503d5a84e49c): created successfully Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c201a40-28b5-4ba0-9e93-04b55694b406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Flow 'volume_create_manager' (98331d10-40a1-49ef-abd1-3fa463699fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d9ccd479-459c-492c-aea0-478594f08ffd tempest-VolumesTransfersTest-1711204199 None] Created volume successfully. Sep 28 15:07:15 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" returned: 0 in 0.478s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979 Sep 28 15:07:15 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" returned: 0 in 0.328s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Lock "cinder-quobyte-52fa5a7a-0f8d-4fa0-94a2-4fdea347b979" released by "delete_volume" :: held 0.918s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Created reservations ['2fc771ff-ea46-4c07-a0cd-fff5d6326b0d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:16 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 1073741824" returned: 0 in 0.674s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Created reservations ['2881a493-2c9b-4825-902e-bf8a3a5062df', '4b8f5f77-dda9-43a3-9582-6e6f8077d97f', 'a13ea479-d984-4558-a22d-6c94c386d412', 'f10b9e95-32a4-4017-9975-2ae8dfc674e0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 Sep 28 15:07:16 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:16 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49" returned: 0 in 0.436s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19043d9d-b5a8-4756-a4a3-c063679a10ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492ab0d8-cd9c-49b4-97fc-929147134f49', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69378e4-2697-4fc4-9458-b8b0c33d4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Volume volume-492ab0d8-cd9c-49b4-97fc-929147134f49 (492ab0d8-cd9c-49b4-97fc-929147134f49): created successfully Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69378e4-2697-4fc4-9458-b8b0c33d4956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (c48da899-31a5-4b57-9a3b-2defc2a0f3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7750e0c1-1eea-4f6f-ae82-f8a63c2f7898 tempest-GroupSnapshotsTest-1477347644 None] Created volume successfully. Sep 28 15:07:16 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.454s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b8d3bb61-1b39-4ee9-ac57-86600dbc7e8a tempest-GroupsV314Test-1525888706 None] Delete group completed successfully. Sep 28 15:07:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4cc058d7-fa31-40a4-adb9-19648168a30e tempest-VolumesTransfersTest-1193041797 None] Transfer volume completed successfully. Sep 28 15:07:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4c4b5548-f430-4015-9bed-8c7fcb043476 tempest-GroupSnapshotsTest-1477347644 None] Update group completed successfully. Sep 28 15:07:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Acquiring lock "cinder-e1c074a3-1e9f-4c07-90ae-503d5a84e49c-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-e1c074a3-1e9f-4c07-90ae-503d5a84e49c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Acquiring lock "cinder-quobyte-e1c074a3-1e9f-4c07-90ae-503d5a84e49c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-quobyte-e1c074a3-1e9f-4c07-90ae-503d5a84e49c" acquired by "delete_volume" :: waited 0.042s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d03c2-f244-4b1c-a921-843fbeb310c9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-60f2f627-ad41-42f9-8f63-2995157b0689 tempest-GroupSnapshotsTest-1477347644 None] Update group completed successfully. Sep 28 15:07:19 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c Sep 28 15:07:19 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:19 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c" returned: 0 in 0.582s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:19 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c Sep 28 15:07:19 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:20 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1c074a3-1e9f-4c07-90ae-503d5a84e49c" returned: 0 in 0.477s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-quobyte-e1c074a3-1e9f-4c07-90ae-503d5a84e49c" released by "delete_volume" :: held 1.153s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7968164e-1f18-4ac8-b162-6994dab8bb2c tempest-GroupSnapshotsTest-1477347644 None] Update group completed successfully. Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Created reservations ['de730f45-1c02-4e96-aaa4-c115f71a5c4c', 'a8277c7c-d6b5-4231-9404-68ca5e7fa585', '928c22a3-b20d-4f5f-bdb9-24106cf74add', '38590c54-5c98-404d-a46c-c45a8fe1c728'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:20 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:20 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:20 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.354s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Deleted volume successfully. Sep 28 15:07:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-90b2eede-5820-46e7-9440-f0e19d68e374 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-e1c074a3-1e9f-4c07-90ae-503d5a84e49c-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-69b09c73-c1a0-4e67-ac4f-13d192a009ba tempest-GroupSnapshotsTest-1477347644 None] Update group completed successfully. Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Flow 'volume_create_manager' (85a842b5-f05f-49e0-afb0-1aceba359fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7f05e0-e010-4471-b9b4-e3f7cee08b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7f05e0-e010-4471-b9b4-e3f7cee08b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-626482320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb54b3d-6d1e-47d0-b240-2cdc00277d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f3fba58d7c435290803dc5c27e74c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:22Z,use_quota=True,user_id='f7869e6c72ae4225ae0cb5266188757d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d8cbb4-acad-432b-b5f4-6fe5f2322a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d8cbb4-acad-432b-b5f4-6fe5f2322a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c889f6f9-53b3-4cab-ba57-cd6d6c13ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c889f6f9-53b3-4cab-ba57-cd6d6c13ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb54b3d-6d1e-47d0-b240-2cdc00277d97', 'volume_name': 'volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c484ebe6-e921-4186-b043-ab3c94ab5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c484ebe6-e921-4186-b043-ab3c94ab5673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2880d01e-e715-4d89-8748-852adb6a3d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:22 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Volume cbb54b3d-6d1e-47d0-b240-2cdc00277d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97', 'volume_size': 1} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-626482320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb54b3d-6d1e-47d0-b240-2cdc00277d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f3fba58d7c435290803dc5c27e74c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:22Z,use_quota=True,user_id='f7869e6c72ae4225ae0cb5266188757d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Creating volume cbb54b3d-6d1e-47d0-b240-2cdc00277d97 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:22 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:22 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 1073741824 Sep 28 15:07:22 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:22 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 1073741824" returned: 0 in 0.724s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:23 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 Sep 28 15:07:23 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:23 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97" returned: 0 in 0.347s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2880d01e-e715-4d89-8748-852adb6a3d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0681d420-c3f1-4b80-8989-3abd432230ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] GroupSnapshot 25b1928c-aa77-4749-8122-5dc5e99315f8: creating. Sep 28 15:07:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Volume volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 (cbb54b3d-6d1e-47d0-b240-2cdc00277d97): created successfully Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0681d420-c3f1-4b80-8989-3abd432230ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Flow 'volume_create_manager' (85a842b5-f05f-49e0-afb0-1aceba359fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Group snapshot 25b1928c-aa77-4749-8122-5dc5e99315f8: creating. {{(pid=87124) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-29234b14-d480-4940-981b-a808a2496f40 tempest-VolumesTransfersTest-1711204199 None] Created volume successfully. Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Creating offline snapshot c8fd9484-62f3-466d-8a02-84441eb2ac20 of volume 492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8abda4-4dac-4058-b0de-3391e96675a9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:23 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 Sep 28 15:07:23 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:24 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49" returned: 0 in 0.479s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:24 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 1G Sep 28 15:07:24 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Acquiring lock "cinder-cbb54b3d-6d1e-47d0-b240-2cdc00277d97-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-cbb54b3d-6d1e-47d0-b240-2cdc00277d97-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:24 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 1G" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ab0d8-cd9c-49b4-97fc-929147134f49 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Acquiring lock "cinder-quobyte-cbb54b3d-6d1e-47d0-b240-2cdc00277d97" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:24 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ab0d8-cd9c-49b4-97fc-929147134f49 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 Sep 28 15:07:24 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-quobyte-cbb54b3d-6d1e-47d0-b240-2cdc00277d97" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4812b5c2-9911-4880-99fb-7b5ebb479354]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:24 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 Sep 28 15:07:24 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:25 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ab0d8-cd9c-49b4-97fc-929147134f49 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20" returned: 0 in 0.506s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:25 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:25 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 Sep 28 15:07:25 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:25 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97" returned: 0 in 0.483s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:25 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97 Sep 28 15:07:25 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:25 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20" returned: 0 in 0.350s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:25 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info Sep 28 15:07:25 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:25 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb54b3d-6d1e-47d0-b240-2cdc00277d97" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-quobyte-cbb54b3d-6d1e-47d0-b240-2cdc00277d97" released by "delete_volume" :: held 1.019s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:25 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Created reservations ['18b20bbf-85ac-492a-9fa7-c422ee858b81', '232bd605-1978-4c56-a9a1-b2d06fd31ec4', '16526f8b-3f7f-4a29-aad3-d491a82f3742', '312ef077-db26-4b8a-860a-e2432b73f4e6'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:26 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info" returned: 0 in 0.445s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:26 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:26 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info Sep 28 15:07:26 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:26 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:26 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:26 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.info" returned: 0 in 0.480s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Creating offline snapshot f5889704-ea40-4c2f-8fce-760df4fdafab of volume c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:26 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.537s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bd7c7f-0f9b-4c1a-afae-a4ab6c4d2d4a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Deleted volume successfully. Sep 28 15:07:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bf4abca3-eb94-481a-8752-cbdee8459927 tempest-VolumesTransfersTest-1508416492 None] Lock "cinder-cbb54b3d-6d1e-47d0-b240-2cdc00277d97-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:26 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f Sep 28 15:07:26 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:27 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f" returned: 0 in 0.668s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:27 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab 1G Sep 28 15:07:27 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:28 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab 1G" returned: 0 in 0.783s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:28 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab Sep 28 15:07:28 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:28 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab" returned: 0 in 0.740s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:28 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:28 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab Sep 28 15:07:28 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:29 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab" returned: 0 in 0.369s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:29 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info Sep 28 15:07:29 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:29 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:29 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:29 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info Sep 28 15:07:29 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:30 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.info" returned: 0 in 0.477s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.616s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:30 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5f7639ab-2165-4e0c-94e0-86a6509d741e tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 25b1928c-aa77-4749-8122-5dc5e99315f8: created successfully Sep 28 15:07:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 25b1928c-aa77-4749-8122-5dc5e99315f8: deleting Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 25b1928c-aa77-4749-8122-5dc5e99315f8: deleting {{(pid=87124) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-492ab0d8-cd9c-49b4-97fc-929147134f49" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-492ab0d8-cd9c-49b4-97fc-929147134f49" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-c8fd9484-62f3-466d-8a02-84441eb2ac20" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-c8fd9484-62f3-466d-8a02-84441eb2ac20" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Deleting offline snapshot c8fd9484-62f3-466d-8a02-84441eb2ac20 of volume 492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] snapshot_file for this snap is: volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c4bceb-38ab-48a5-9728-ea91f97c54a6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:31 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 Sep 28 15:07:31 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:32 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20" returned: 0 in 0.613s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-492ab0d8-cd9c-49b4-97fc-929147134f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:32 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaee386-d2fe-4518-a268-1133860855fa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:32 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 Sep 28 15:07:32 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:32 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49" returned: 0 in 0.510s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:32 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 Sep 28 15:07:32 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:33 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20" returned: 0 in 0.655s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:33 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20 Sep 28 15:07:33 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:33 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49.c8fd9484-62f3-466d-8a02-84441eb2ac20" returned: 0 in 0.355s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-c8fd9484-62f3-466d-8a02-84441eb2ac20" released by "_delete_snapshot" :: held 2.296s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-492ab0d8-cd9c-49b4-97fc-929147134f49" released by "delete_snapshot" :: held 2.353s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-c2c5cda6-b88b-4285-88be-fd54d2a1023f" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-c2c5cda6-b88b-4285-88be-fd54d2a1023f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-f5889704-ea40-4c2f-8fce-760df4fdafab" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-f5889704-ea40-4c2f-8fce-760df4fdafab" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Deleting offline snapshot f5889704-ea40-4c2f-8fce-760df4fdafab of volume c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] snapshot_file for this snap is: volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21ea355-6970-48c4-85af-b4dbc54837cf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:34 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab Sep 28 15:07:34 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:34 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab" returned: 0 in 0.566s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e5351b-3712-4321-a5c6-0e9e21a92651]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:34 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f Sep 28 15:07:34 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:35 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f" returned: 0 in 0.626s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:35 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab Sep 28 15:07:35 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:35 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab" returned: 0 in 0.603s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:36 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab Sep 28 15:07:36 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:36 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f.f5889704-ea40-4c2f-8fce-760df4fdafab" returned: 0 in 0.437s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-f5889704-ea40-4c2f-8fce-760df4fdafab" released by "_delete_snapshot" :: held 2.418s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-c2c5cda6-b88b-4285-88be-fd54d2a1023f" released by "delete_snapshot" :: held 2.465s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:36 devstack cinder-volume[87124]: WARNING cinder.quota [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2123575022 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2123575022, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:36 devstack cinder-volume[87124]: WARNING cinder.quota [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2123575022 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2123575022, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:36 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['5cf40bb1-8e02-4493-ba15-b005202a963e', 'e9846cdc-b1d4-4c91-8fbc-07d1786e10c4', 'e2819b83-728f-4035-9d41-745f3d8d943f', '5d183e02-a255-4c3a-a570-e89730eb9402'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:36 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['ed4c0d45-f165-48c2-b5f2-2d98cdbaac00', 'd1f15ff1-3672-4937-acba-04e3e6e74109', 'ee28710d-a923-446b-805b-1ce6772d6f1b', '211f0cb6-a91f-49c6-b3aa-a7213679447d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ec4a5965-fb50-4762-9cc8-c997c379ea9c tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 25b1928c-aa77-4749-8122-5dc5e99315f8: deleted successfully Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:37 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:37 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:37 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.381s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:07:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:07:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-492ab0d8-cd9c-49b4-97fc-929147134f49" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-492ab0d8-cd9c-49b4-97fc-929147134f49" acquired by "delete_volume" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:38 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec76ef1-2657-4bab-8df0-d149ceac08b3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:38 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 Sep 28 15:07:38 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:38 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49" returned: 0 in 0.605s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:38 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49 Sep 28 15:07:38 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:39 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-492ab0d8-cd9c-49b4-97fc-929147134f49" returned: 0 in 0.539s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-492ab0d8-cd9c-49b4-97fc-929147134f49" released by "delete_volume" :: held 1.297s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-c2c5cda6-b88b-4285-88be-fd54d2a1023f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-c2c5cda6-b88b-4285-88be-fd54d2a1023f" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[518fdbe3-d781-4d2a-a5b3-daadc0a26a29]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:39 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f Sep 28 15:07:39 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:40 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (0a7b88f7-6cf9-4adb-ac4a-2822ad34b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0bbe6-7509-4b4c-b441-eceb7272ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f" returned: 0 in 0.746s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0bbe6-7509-4b4c-b441-eceb7272ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-576508954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e949003c-1c75-4b3e-a1d9-1cc2d7b33b61,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:40Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b9cd46-c958-4844-89d0-7780a14cc6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b9cd46-c958-4844-89d0-7780a14cc6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1a9187-31ff-4b20-a8f6-837f1f67e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1a9187-31ff-4b20-a8f6-837f1f67e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e949003c-1c75-4b3e-a1d9-1cc2d7b33b61', 'volume_name': 'volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a36f24-d4e6-4a97-b34b-7d28d3a0570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a36f24-d4e6-4a97-b34b-7d28d3a0570a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdb12f3-e4dd-4048-bd73-321c63e87b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Volume e949003c-1c75-4b3e-a1d9-1cc2d7b33b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61', 'volume_size': 1} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-576508954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e949003c-1c75-4b3e-a1d9-1cc2d7b33b61,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:40Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Creating volume e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:40 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:40 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 1073741824 Sep 28 15:07:40 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Flow 'volume_create_manager' (8b8433a2-8e7e-4ae4-a289-cf250bf841ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a27a668-c6e8-4944-99e8-18f6c117ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a27a668-c6e8-4944-99e8-18f6c117ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1113505262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f106eaf5-70fa-4f1d-9f99-c0368b8e08c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3fe08c0aea4822b3efcfdd1eedd9e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:41Z,use_quota=True,user_id='65b92693e811436da64695a76e6727b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e759f2-9b9f-4c12-b611-78227d332bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e759f2-9b9f-4c12-b611-78227d332bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5746a016-ebb6-4f5c-a285-75043864ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5746a016-ebb6-4f5c-a285-75043864ff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f106eaf5-70fa-4f1d-9f99-c0368b8e08c2', 'volume_name': 'volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668da84d-5794-435b-ac51-efcb0b4b2c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668da84d-5794-435b-ac51-efcb0b4b2c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e538dd38-1c7a-4042-b840-288f573f919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2', 'volume_size': 1} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c2c5cda6-b88b-4285-88be-fd54d2a1023f" returned: 0 in 0.603s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-c2c5cda6-b88b-4285-88be-fd54d2a1023f" released by "delete_volume" :: held 1.457s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['97c9de05-6d53-45ff-b8f9-f5a852e872f3'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:41 devstack cinder-volume[87124]: WARNING cinder.quota [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2123575022 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2123575022, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['392b4883-e751-4025-98e8-369de6cce432', '22b0e6b0-9e42-4dd5-ab14-061c50a3f000', '4f507743-c5e1-4d6d-b848-b4ec4d2bc498', 'de730bee-fac1-479f-9d48-5d4dbbb8a4d9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:41 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 1073741824" returned: 0 in 0.894s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['31888bbc-c54e-4b83-98ee-d571c479b8a6', 'db92b998-7a27-46af-8415-372d37ea649a', '83e4fcf6-3dda-4764-af47-7b7cc3097ff1', 'c2d40fee-e329-4f77-b9bf-4093ae371dcc'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:41 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 Sep 28 15:07:41 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:41 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:41 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:41 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61" returned: 0 in 0.411s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1113505262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f106eaf5-70fa-4f1d-9f99-c0368b8e08c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3fe08c0aea4822b3efcfdd1eedd9e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:41Z,use_quota=True,user_id='65b92693e811436da64695a76e6727b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Creating volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:41 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdb12f3-e4dd-4048-bd73-321c63e87b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:41 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 1073741824 Sep 28 15:07:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9242b2-68a2-4a93-afa7-dd53358feed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:41 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Volume volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 (e949003c-1c75-4b3e-a1d9-1cc2d7b33b61): created successfully Sep 28 15:07:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9242b2-68a2-4a93-afa7-dd53358feed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (0a7b88f7-6cf9-4adb-ac4a-2822ad34b9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:42 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f1c3149d-96c8-4b23-af9a-d0f195e428dd tempest-GroupSnapshotsTest-1477347644 None] Delete group completed successfully. Sep 28 15:07:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f9660a28-cdcc-4803-a464-f8f0bf2fcc3d tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:07:42 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 1073741824" returned: 0 in 0.762s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 Sep 28 15:07:42 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:43 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" returned: 0 in 0.546s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e538dd38-1c7a-4042-b840-288f573f919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e3a7e7-baf5-4b7a-be11-6b01008d7750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Volume volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 (f106eaf5-70fa-4f1d-9f99-c0368b8e08c2): created successfully Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e3a7e7-baf5-4b7a-be11-6b01008d7750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Flow 'volume_create_manager' (8b8433a2-8e7e-4ae4-a289-cf250bf841ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ea18df54-90c4-4550-a2e9-081a7074d924 tempest-SnapshotsActionsTest-376606126 None] Created volume successfully. Sep 28 15:07:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6bdfe132-f564-4e09-b8b5-b78a390fae92 tempest-GroupSnapshotsTest-1477347644 None] Group tempest-GroupSnapshotsTest-Group-1878692394: creating Sep 28 15:07:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6bdfe132-f564-4e09-b8b5-b78a390fae92 tempest-GroupSnapshotsTest-1477347644 None] Group tempest-GroupSnapshotsTest-Group-1878692394: created successfully Sep 28 15:07:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6bdfe132-f564-4e09-b8b5-b78a390fae92 tempest-GroupSnapshotsTest-1477347644 None] Create group completed successfully. Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (6808a93c-56dd-48bb-9d92-89a9d859287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd986ca3-7ace-4961-995f-d235f8d05fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd986ca3-7ace-4961-995f-d235f8d05fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1970138607',display_name='tempest-VolumesGetTest-Volume-1411174449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:44Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fe0722-412e-4cd7-8bbb-ab781a3c0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fe0722-412e-4cd7-8bbb-ab781a3c0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73abcfc2-d6c2-49f9-81b3-c9e798547df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73abcfc2-d6c2-49f9-81b3-c9e798547df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2', 'volume_name': 'volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12360b3-e73a-4f03-ac09-5ebba12157a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12360b3-e73a-4f03-ac09-5ebba12157a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f3a02f-0c22-462a-9bc5-dbb4ab57740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Volume 9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2', 'volume_size': 1} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Creating offline snapshot 544770c6-b8a2-4011-a829-7c736453f192 of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec2723-cf71-4c2b-9a5b-59534c608b11]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:44 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 Sep 28 15:07:44 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" returned: 0 in 0.717s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 1G Sep 28 15:07:45 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (b0f042a4-d4a7-4e01-9266-76d7314e5b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af34351a-fa3a-4b10-a675-a27abc64a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af34351a-fa3a-4b10-a675-a27abc64a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236316267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bd857af-7263-4490-bb69-f54a0b942b2f,host='devstack@QuobyteHD#QuobyteHD',id=70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:45Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e0aab90-b47d-4df8-a309-01f4804c725a),volume_type_id=4e0aab90-b47d-4df8-a309-01f4804c725a)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a660d7-d5dd-475e-9e0e-d9e85b589eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a660d7-d5dd-475e-9e0e-d9e85b589eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef46ab8-083a-4504-ad9e-a8143285c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef46ab8-083a-4504-ad9e-a8143285c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c', 'volume_name': 'volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e90001-be83-4a21-9b82-70f15d10d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e90001-be83-4a21-9b82-70f15d10d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c20fe34-a0bd-4175-aab5-8133b3dbabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Volume 70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c', 'volume_size': 1} Sep 28 15:07:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:46 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 1G" returned: 0 in 0.634s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:46 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:07:46 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:46 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.368s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 is being set with open permissions: ugo+rw Sep 28 15:07:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:46 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:07:46 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:46 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.394s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:46 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info Sep 28 15:07:46 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:47 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info" returned: 0 in 0.303s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:47 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info is being set with open permissions: ugo+rw Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:47 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info Sep 28 15:07:47 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:47 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.info" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.032s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1970138607',display_name='tempest-VolumesGetTest-Volume-1411174449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:44Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Creating volume 9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:47 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:47 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 1073741824 Sep 28 15:07:47 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ca428fcb-2c78-4685-b4c5-f0bea7f449ed tempest-SnapshotsActionsTest-376606126 None] Create snapshot completed successfully Sep 28 15:07:48 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 1073741824" returned: 0 in 0.549s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 Sep 28 15:07:48 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:48 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2" returned: 0 in 0.290s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6bd857af-7263-4490-bb69-f54a0b942b2f,created_at=2026-09-28T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236316267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bd857af-7263-4490-bb69-f54a0b942b2f,host='devstack@QuobyteHD#QuobyteHD',id=70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c377a34dacb74fddad6645727859ccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:45Z,use_quota=True,user_id='da63a454d5a14a96a60434678c766227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e0aab90-b47d-4df8-a309-01f4804c725a),volume_type_id=4e0aab90-b47d-4df8-a309-01f4804c725a)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Creating volume 70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:48 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=157,cinder:UPDATE=179,cinder:INSERT=46,cinder:DELETE=8 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:48 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c 1073741824 Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f3a02f-0c22-462a-9bc5-dbb4ab57740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42486244-d34e-4e2b-a739-4e69b033ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=147,cinder:UPDATE=184,cinder:DELETE=9,cinder:INSERT=39 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Volume volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 (9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2): created successfully Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42486244-d34e-4e2b-a739-4e69b033ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (6808a93c-56dd-48bb-9d92-89a9d859287f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cd54d6c3-9956-45c6-9ea1-c279622b9bf5 tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Lock "cinder-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d3767-d567-4385-b72b-f7641d361b0f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:49 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c 1073741824" returned: 0 in 0.832s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:49 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 Sep 28 15:07:49 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:49 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c Sep 28 15:07:49 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:49 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" returned: 0 in 0.438s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:49 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2" returned: 0 in 0.745s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c20fe34-a0bd-4175-aab5-8133b3dbabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97071b06-06c0-4208-9a5c-ec4974863303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Creating offline snapshot a181c0bf-c8e3-4b57-a5cb-3793335d9bcd of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:49 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2 Sep 28 15:07:49 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Volume volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c (70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c): created successfully Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97071b06-06c0-4208-9a5c-ec4974863303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Flow 'volume_create_manager' (b0f042a4-d4a7-4e01-9266-76d7314e5b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed3895-9ec8-4c03-b122-2a0b3ca16f6a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-480f7185-60fa-4e4f-945f-90414fe8dc7b tempest-GroupSnapshotsTest-1477347644 None] Created volume successfully. Sep 28 15:07:50 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:07:50 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2" returned: 0 in 0.424s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2" released by "delete_volume" :: held 1.268s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Created reservations ['9666d28a-0a45-4529-ad24-2c2a8418f195', '7fb71340-b4d6-4e0d-a12e-ecd1abf16b49', 'ceae0b09-880e-4cd2-a389-580aa5d4388d', '63fd7aa8-7649-4d44-b22d-e97f6b39b9ae'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:50 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:50 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.656s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:50 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd 1G Sep 28 15:07:50 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] GroupSnapshot 7deb1fd9-a0a0-4b26-8486-bc4d0585ad2f: creating. Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Group snapshot 7deb1fd9-a0a0-4b26-8486-bc4d0585ad2f: creating. {{(pid=87124) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:51 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.497s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e836d15-ace0-45aa-9365-f585615d2012 tempest-VolumesGetTest-975374711 None] Lock "cinder-9aa6d21f-64f6-417f-9e77-ebec9fe4ddc2-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Lock "cinder-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:51 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd 1G" returned: 0 in 0.907s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e763ebe-98f6-485d-a991-e47c3d78ca0e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:51 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd Sep 28 15:07:51 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:51 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 Sep 28 15:07:51 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" returned: 0 in 0.448s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd is being set with open permissions: ugo+rw Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd Sep 28 15:07:52 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61" returned: 0 in 0.582s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61 Sep 28 15:07:52 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" returned: 0 in 0.446s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.524s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:52 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61" returned: 0 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Creating offline snapshot 797c1a08-1391-4e72-92f9-e9f28c44d2ec of volume 70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61" released by "delete_volume" :: held 1.062s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28b6a60-4617-4685-aa10-a37ca90fdb80]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4d43abcf-4877-48e8-98ef-73292ab97d64 tempest-SnapshotsActionsTest-376606126 None] Create snapshot completed successfully Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Created reservations ['a6b2dd5b-aeed-4c39-8c62-95a2050a4163', '2d11aae3-9431-4573-ab5c-5419f2e085df', '3116950e-ecae-42d6-9b1e-26f05b5f5b85', '2c9ac87f-8240-4277-b26a-22ca01ff6c6d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:52 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c Sep 28 15:07:52 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:07:52 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.489s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-95df0997-f0fe-4593-893c-fe9cea8b6561 tempest-VolumesGetTest-975374711 None] Lock "cinder-e949003c-1c75-4b3e-a1d9-1cc2d7b33b61-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:53 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-a181c0bf-c8e3-4b57-a5cb-3793335d9bcd-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" returned: 0 in 0.877s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-a181c0bf-c8e3-4b57-a5cb-3793335d9bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:53 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec 1G Sep 28 15:07:53 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Deleting offline snapshot a181c0bf-c8e3-4b57-a5cb-3793335d9bcd of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] snapshot_file for this snap is: volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[833ef6ca-2520-4650-a690-69367b3bfcd8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:53 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd Sep 28 15:07:53 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec 1G" returned: 0 in 0.767s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec Sep 28 15:07:54 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" returned: 0 in 0.622s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e6c6a-e232-4dfe-b587-2bab939296a3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:07:54 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (04ab9f79-73c6-4ecf-9847-04bc4b0a9cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934fc3ef-801a-44fb-981d-19f3ce88414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934fc3ef-801a-44fb-981d-19f3ce88414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-341009826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52b11f0-e4fc-44be-b429-8dc0d3724292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:55Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2b9cc3-e0c2-49e5-aadf-0e192da9f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2b9cc3-e0c2-49e5-aadf-0e192da9f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c2775a-d16e-44cc-82b1-40e7351e5942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c2775a-d16e-44cc-82b1-40e7351e5942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52b11f0-e4fc-44be-b429-8dc0d3724292', 'volume_name': 'volume-b52b11f0-e4fc-44be-b429-8dc0d3724292', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60b06d9-62d3-45f4-b6bd-7f36bcfbf522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60b06d9-62d3-45f4-b6bd-7f36bcfbf522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b519ac-f641-4d1c-9e29-be5bb75f8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Volume b52b11f0-e4fc-44be-b429-8dc0d3724292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52b11f0-e4fc-44be-b429-8dc0d3724292', 'volume_size': 1} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec" returned: 0 in 0.579s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec Sep 28 15:07:54 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.566s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd Sep 28 15:07:55 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec" returned: 0 in 0.294s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info Sep 28 15:07:55 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" returned: 0 in 0.632s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info" returned: 0 in 0.452s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd Sep 28 15:07:55 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info Sep 28 15:07:55 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" returned: 0 in 0.303s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.info" returned: 0 in 0.319s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.460s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-a181c0bf-c8e3-4b57-a5cb-3793335d9bcd" released by "_delete_snapshot" :: held 2.376s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-341009826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52b11f0-e4fc-44be-b429-8dc0d3724292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:55Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Creating volume b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:56 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:56 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 1073741824 Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" released by "delete_snapshot" :: held 2.454s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:56 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2cc94c89-b208-4cc0-bace-075fafbb21e1 tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 7deb1fd9-a0a0-4b26-8486-bc4d0585ad2f: created successfully Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Created reservations ['2ac3f388-1644-4c96-b7e1-c79d13eb930f', 'be29a846-3124-4b3a-9fca-c6f116bee12c', '850d4488-f6d4-4b45-ae77-71d45b05a0bd', '7af0d918-c441-4a3e-b138-f0c838587932'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Delete snapshot completed successfully. Sep 28 15:07:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7df353b1-0b9a-40ec-9daa-cad7f55e8815 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-a181c0bf-c8e3-4b57-a5cb-3793335d9bcd-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 7deb1fd9-a0a0-4b26-8486-bc4d0585ad2f: deleting Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 7deb1fd9-a0a0-4b26-8486-bc4d0585ad2f: deleting {{(pid=87124) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-797c1a08-1391-4e72-92f9-e9f28c44d2ec" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-797c1a08-1391-4e72-92f9-e9f28c44d2ec" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:57 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Deleting offline snapshot 797c1a08-1391-4e72-92f9-e9f28c44d2ec of volume 70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] snapshot_file for this snap is: volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 1073741824" returned: 0 in 1.242s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d99b6c-bd0b-481c-b264-66b594d7ce95]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 Sep 28 15:07:57 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec Sep 28 15:07:57 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:58 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292" returned: 0 in 0.621s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.114s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b519ac-f641-4d1c-9e29-be5bb75f8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52b11f0-e4fc-44be-b429-8dc0d3724292', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dccafc-93d6-4ab2-af68-01925223ec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Creating offline snapshot b41f641a-4e73-4358-bfcd-f1a3370bb3ff of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:58 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Volume volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 (b52b11f0-e4fc-44be-b429-8dc0d3724292): created successfully Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dccafc-93d6-4ab2-af68-01925223ec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:58 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (04ab9f79-73c6-4ecf-9847-04bc4b0a9cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af73699-3ee9-48ba-9255-589e369a5ae6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec" returned: 0 in 1.000s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0fb576dd-8ea4-4f7c-b480-cd2afccd3d9b tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f312754-7046-431d-9fb9-8f471c926ca8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:07:58 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c Sep 28 15:07:58 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.590s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" returned: 0 in 0.529s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff 1G Sep 28 15:07:58 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec Sep 28 15:07:58 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:59 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec" returned: 0 in 0.511s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:59 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec Sep 28 15:07:59 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:59 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff 1G" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:59 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff Sep 28 15:07:59 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:00 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c.797c1a08-1391-4e72-92f9-e9f28c44d2ec" returned: 0 in 0.631s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-797c1a08-1391-4e72-92f9-e9f28c44d2ec" released by "_delete_snapshot" :: held 2.933s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff" returned: 0 in 0.582s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:00 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff is being set with open permissions: ugo+rw Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:00 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" released by "delete_snapshot" :: held 3.025s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:00 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff Sep 28 15:08:00 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (7966d369-6f1d-4fab-9f1b-602bbaf778fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ace129b-65c3-43d1-ad46-c8f735fd5bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ace129b-65c3-43d1-ad46-c8f735fd5bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-292904164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16f5ff2-1e4b-4959-a620-c7f8be9daf2e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b52b11f0-e4fc-44be-b429-8dc0d3724292,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:00Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913f8abe-b980-4fd3-887a-a1810135e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913f8abe-b980-4fd3-887a-a1810135e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ca5b6-1898-4c1f-8de7-02376d4aeaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ca5b6-1898-4c1f-8de7-02376d4aeaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c16f5ff2-1e4b-4959-a620-c7f8be9daf2e', 'volume_name': 'volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e', 'volume_size': 1, 'source_volid': 'b52b11f0-e4fc-44be-b429-8dc0d3724292', 'source_volstatus': 'available'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5343f2f-848f-48cb-a973-36eb23c7107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5343f2f-848f-48cb-a973-36eb23c7107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05d6d72-1ea6-446c-bab0-f025d08f0d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:00 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Volume c16f5ff2-1e4b-4959-a620-c7f8be9daf2e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e', 'volume_size': 1, 'source_volid': 'b52b11f0-e4fc-44be-b429-8dc0d3724292', 'source_volstatus': 'available'} Sep 28 15:08:00 devstack cinder-volume[87124]: WARNING cinder.quota [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-229095793 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-229095793, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:00 devstack cinder-volume[87124]: WARNING cinder.quota [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-229095793 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-229095793, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['3b6b14a4-b87b-4d8f-b932-fdf6c5646dee', 'd0404307-3670-4489-9129-3f8cb4fbbc85', '45e49d1f-731c-4d70-a34f-d230335ae21c', 'b423a8da-d6e4-4e76-99ce-14608d554751'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:00 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff" returned: 0 in 0.524s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.223s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:00 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Cloning volume b52b11f0-e4fc-44be-b429-8dc0d3724292 to volume c16f5ff2-1e4b-4959-a620-c7f8be9daf2e Sep 28 15:08:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-346d3967-84a6-4f7e-b713-71e33f50ad6c tempest-GroupSnapshotsTest-1477347644 None] group_snapshot 7deb1fd9-a0a0-4b26-8486-bc4d0585ad2f: deleted successfully Sep 28 15:08:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-24281c8a-3a7c-4f24-a693-f3dca6229f6d tempest-SnapshotsActionsTest-376606126 None] Create snapshot completed successfully Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Creating offline snapshot 08b2a72b-befe-4e51-a71b-7913b2c17d37 of volume b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b05a0-3c7f-4c92-93b6-b67f90b72bec]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:01 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 Sep 28 15:08:01 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-b41f641a-4e73-4358-bfcd-f1a3370bb3ff-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-b41f641a-4e73-4358-bfcd-f1a3370bb3ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-b41f641a-4e73-4358-bfcd-f1a3370bb3ff" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-b41f641a-4e73-4358-bfcd-f1a3370bb3ff" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Deleting offline snapshot b41f641a-4e73-4358-bfcd-f1a3370bb3ff of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] snapshot_file for this snap is: volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1da52-97b9-46b0-bdc2-33b796e1573a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:01 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292" returned: 0 in 0.626s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:01 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 1G Sep 28 15:08:01 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:01 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff Sep 28 15:08:01 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:02 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff" returned: 0 in 0.708s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e316a2c-ea3f-4c4e-9291-781c67b411c6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "cinder-quobyte-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:02 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 1G" returned: 0 in 0.877s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" acquired by "delete_volume" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:02 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:02 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:02 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 Sep 28 15:08:02 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[65114b8b-f95e-4e63-8092-33834aba176f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:02 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c Sep 28 15:08:02 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.927s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" returned: 0 in 0.656s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff Sep 28 15:08:03 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c Sep 28 15:08:03 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (01b01794-3849-4783-be52-57408c0329f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:03 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d4d65d-6ffd-4945-8439-4efcaeb8cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37" returned: 0 in 0.928s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 is being set with open permissions: ugo+rw Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d4d65d-6ffd-4945-8439-4efcaeb8cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-802314430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b313c1c8-3efb-46f8-9e65-d94aa5e339cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:03Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:03 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 Sep 28 15:08:03 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8034cd8-29aa-430d-8a32-c2eb085f9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8034cd8-29aa-430d-8a32-c2eb085f9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dc3e80-c5c7-485d-bada-5bfdd85556cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dc3e80-c5c7-485d-bada-5bfdd85556cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b313c1c8-3efb-46f8-9e65-d94aa5e339cb', 'volume_name': 'volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832d3cc3-706c-4518-b9eb-57d765c076a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832d3cc3-706c-4518-b9eb-57d765c076a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924cbe6a-c67e-4198-ab4d-d74bc132e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:03 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Volume b313c1c8-3efb-46f8-9e65-d94aa5e339cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb', 'volume_size': 1} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:03 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" returned: 0 in 0.511s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Lock "cinder-quobyte-70c9e9f2-d1ff-4a6b-ab8a-714db2cb120c" released by "delete_volume" :: held 1.331s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:03 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37" returned: 0 in 0.487s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff" returned: 0 in 0.660s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff Sep 28 15:08:03 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info Sep 28 15:08:03 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['c7959609-9b7f-4d0a-9070-fc6e744ed3d7'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:04 devstack cinder-volume[87124]: WARNING cinder.quota [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-229095793 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-229095793, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Created reservations ['5329c6a2-b711-43a8-878f-0a36898d37dc', '0d97673e-2323-4773-9bb4-52f4eeed7fe3', '7ef1d9c3-46f9-4aba-90bd-1b9f02a6283d', '259ff9c6-b7bb-485f-95ca-8f363f80c883'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:04 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.b41f641a-4e73-4358-bfcd-f1a3370bb3ff" returned: 0 in 0.392s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-b41f641a-4e73-4358-bfcd-f1a3370bb3ff" released by "_delete_snapshot" :: held 2.864s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" released by "delete_snapshot" :: held 2.901s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:04 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info" returned: 0 in 0.453s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info is being set with open permissions: ugo+rw Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:04 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info Sep 28 15:08:04 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:04 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:04 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Created reservations ['ff7caac3-eaa8-4147-aa52-4d2aede27d1e', '3baef1ff-695f-4dd6-809e-223ffa8ad9cc', '802ca2c9-6a35-44d7-a395-820f79c45bdd', '22f0041e-08bb-4c9b-9f93-663ccabedbfc'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:04 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Delete snapshot completed successfully. Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7a9362b7-d5ef-4b51-92f6-ee83cb233794 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-b41f641a-4e73-4358-bfcd-f1a3370bb3ff-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:04 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.info" returned: 0 in 0.331s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] snapshot: 08b2a72b-befe-4e51-a71b-7913b2c17d37, volume: c16f5ff2-1e4b-4959-a620-c7f8be9daf2e, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:04 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.381s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[161c25bd-adeb-472d-847b-92c5834b4e4d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:04 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c14c5995-d11e-410a-9ae1-0d6ba15aab76 tempest-GroupSnapshotsTest-1477347644 None] Delete group completed successfully. Sep 28 15:08:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:04 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 Sep 28 15:08:04 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:05 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37" returned: 0 in 0.546s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b52b11f0-e4fc-44be-b429-8dc0d3724292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65b45b-054a-4592-b7fb-7af916813dce]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:05 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 Sep 28 15:08:05 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:05 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292" returned: 0 in 0.521s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:08:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:05 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e Sep 28 15:08:05 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=59,cinder:UPDATE=47,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=65,cinder:DELETE=5,cinder:SELECT=48,cinder:INSERT=15 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:15 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" returned: 0 in 9.683s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292, size 1024.00 MB, duration 9.68 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:08:15 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Converted 1024.00 MB image at 105.74 MB/s Sep 28 15:08:15 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e is being set with open permissions: ugo+rw Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:15 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e Sep 28 15:08:15 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:15 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" returned: 0 in 0.302s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" released by "_copy_volume_from_snapshot" :: held 11.167s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-08b2a72b-befe-4e51-a71b-7913b2c17d37" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-08b2a72b-befe-4e51-a71b-7913b2c17d37" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Deleting offline snapshot 08b2a72b-befe-4e51-a71b-7913b2c17d37 of volume b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] snapshot_file for this snap is: volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d572d50d-398b-49c4-a834-41349447287a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:16 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 Sep 28 15:08:16 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:16 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b52b11f0-e4fc-44be-b429-8dc0d3724292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:16 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[afebdfcd-bbfa-4e8e-a2bb-d428d1a3b6db]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:16 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 Sep 28 15:08:16 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:17 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292" returned: 0 in 0.621s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:17 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 Sep 28 15:08:17 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:17 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37" returned: 0 in 0.407s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:17 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37 Sep 28 15:08:17 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:17 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292.08b2a72b-befe-4e51-a71b-7913b2c17d37" returned: 0 in 0.309s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-08b2a72b-befe-4e51-a71b-7913b2c17d37" released by "_delete_snapshot" :: held 1.885s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.059s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.402s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-802314430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b313c1c8-3efb-46f8-9e65-d94aa5e339cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:03Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Creating volume b313c1c8-3efb-46f8-9e65-d94aa5e339cb {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:17 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:17 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb 1073741824 Sep 28 15:08:17 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05d6d72-1ea6-446c-bab0-f025d08f0d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e', 'volume_size': 1, 'source_volid': 'b52b11f0-e4fc-44be-b429-8dc0d3724292', 'source_volstatus': 'available'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e5a97b-6919-40c9-8faf-65a21b0ed87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:17 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Volume volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e (c16f5ff2-1e4b-4959-a620-c7f8be9daf2e): created successfully Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e5a97b-6919-40c9-8faf-65a21b0ed87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (7966d369-6f1d-4fab-9f1b-602bbaf778fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-45fb2e7d-eefe-4720-a2a3-62d816ce956c tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:08:18 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb 1073741824" returned: 0 in 0.590s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:18 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb Sep 28 15:08:18 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:18 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" returned: 0 in 0.365s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.555s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924cbe6a-c67e-4198-ab4d-d74bc132e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257676d9-0320-414e-85aa-0963869ff377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Creating offline snapshot ea4aebb7-c3bf-462c-9463-b6faa7c7d77d of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:19 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Volume volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb (b313c1c8-3efb-46f8-9e65-d94aa5e339cb): created successfully Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257676d9-0320-414e-85aa-0963869ff377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (01b01794-3849-4783-be52-57408c0329f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4fbae-9fd9-45a7-9b53-0fb4d2579248]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-da2e6715-7fdf-4f48-b166-3589ae44405d tempest-VolumesActionsTest-931205019 None] Created volume successfully. Sep 28 15:08:19 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:19 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fece4b9c-13d0-4d6f-8404-8661aff8fd2a tempest-VolumesActionsTest-931205019 None] Acquiring lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" by "attach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fece4b9c-13d0-4d6f-8404-8661aff8fd2a tempest-VolumesActionsTest-931205019 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" acquired by "attach_volume" :: waited 0.044s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-fece4b9c-13d0-4d6f-8404-8661aff8fd2a tempest-VolumesActionsTest-931205019 None] Attaching volume b313c1c8-3efb-46f8-9e65-d94aa5e339cb to instance ebd94d08-8f97-4600-bd93-375878364b83 at mountpoint /dev/vdb on host None. Sep 28 15:08:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-fece4b9c-13d0-4d6f-8404-8661aff8fd2a tempest-VolumesActionsTest-931205019 None] Attach volume completed successfully. Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-fece4b9c-13d0-4d6f-8404-8661aff8fd2a tempest-VolumesActionsTest-931205019 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" released by "attach_volume" :: held 0.179s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:19 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.622s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:19 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d 1G Sep 28 15:08:19 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (4d1b9aa6-929b-4094-8e66-424bcfc127fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a786c84b-152f-4e97-80bf-860397f20816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a786c84b-152f-4e97-80bf-860397f20816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197272104',display_name='tempest-VolumesGetTest-Volume-1928906338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95940a8-62d1-4237-9e27-4c65b4905626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:20Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc6e078-6734-484a-9ce5-2c9275bcf5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc6e078-6734-484a-9ce5-2c9275bcf5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18349b4-dd77-4df6-bc39-89edf88d0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18349b4-dd77-4df6-bc39-89edf88d0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95940a8-62d1-4237-9e27-4c65b4905626', 'volume_name': 'volume-c95940a8-62d1-4237-9e27-4c65b4905626', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e28bdb-c403-4cab-bcfa-180b4f4b1485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e28bdb-c403-4cab-bcfa-180b4f4b1485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a78e992-8f45-42fd-8a90-baa9cdc5bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Volume c95940a8-62d1-4237-9e27-4c65b4905626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95940a8-62d1-4237-9e27-4c65b4905626', 'volume_size': 1} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:20 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d 1G" returned: 0 in 0.836s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:20 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d Sep 28 15:08:20 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f1eae2a3-7208-4e6d-a53f-ce4953321362 tempest-VolumesActionsTest-1498831149 None] Terminate volume connection completed successfully. Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1eae2a3-7208-4e6d-a53f-ce4953321362 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-detach_volume" by "detach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1eae2a3-7208-4e6d-a53f-ce4953321362 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f1eae2a3-7208-4e6d-a53f-ce4953321362 tempest-VolumesActionsTest-1498831149 None] Detaching volume b313c1c8-3efb-46f8-9e65-d94aa5e339cb from instance ebd94d08-8f97-4600-bd93-375878364b83. Sep 28 15:08:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f1eae2a3-7208-4e6d-a53f-ce4953321362 tempest-VolumesActionsTest-1498831149 None] Detach volume completed successfully. Sep 28 15:08:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f1eae2a3-7208-4e6d-a53f-ce4953321362 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:21 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" returned: 0 in 0.566s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:21 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d is being set with open permissions: ugo+rw Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7ef8b3ed-6f95-4d92-bb36-01c5989f4270 tempest-VolumesActionsTest-931205019 None] Acquiring lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-detach_volume" by "detach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:21 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d Sep 28 15:08:21 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7ef8b3ed-6f95-4d92-bb36-01c5989f4270 tempest-VolumesActionsTest-931205019 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7ef8b3ed-6f95-4d92-bb36-01c5989f4270 tempest-VolumesActionsTest-931205019 None] Volume detach called, but volume not attached. Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7ef8b3ed-6f95-4d92-bb36-01c5989f4270 tempest-VolumesActionsTest-931205019 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Acquiring lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:21 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197272104',display_name='tempest-VolumesGetTest-Volume-1928906338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95940a8-62d1-4237-9e27-4c65b4905626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:20Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Creating volume c95940a8-62d1-4237-9e27-4c65b4905626 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:21 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:21 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 1073741824 Sep 28 15:08:21 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Acquiring lock "cinder-quobyte-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cda19a7e-30ed-43fc-9d26-9ec93b4001b2 tempest-SnapshotsActionsTest-376606126 None] Create snapshot completed successfully Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Lock "cinder-quobyte-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4e8e2-3ae5-4594-b09a-6facf742d596]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:22 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb Sep 28 15:08:22 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-ea4aebb7-c3bf-462c-9463-b6faa7c7d77d-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-ea4aebb7-c3bf-462c-9463-b6faa7c7d77d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Deleting offline snapshot ea4aebb7-c3bf-462c-9463-b6faa7c7d77d of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] snapshot_file for this snap is: volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b93139a-6188-4d6e-8c69-8c85458a26d0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:22 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" returned: 0 in 0.720s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:22 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:22 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 1073741824" returned: 0 in 0.956s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:22 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:22 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d Sep 28 15:08:22 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:22 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 Sep 28 15:08:22 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:22 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Lock "cinder-quobyte-b313c1c8-3efb-46f8-9e65-d94aa5e339cb" released by "delete_volume" :: held 1.348s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:23 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" returned: 0 in 0.798s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:23 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a381d2-3692-426d-a2cb-496455d069cf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626" returned: 0 in 0.565s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a78e992-8f45-42fd-8a90-baa9cdc5bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95940a8-62d1-4237-9e27-4c65b4905626', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cffbbac-baf5-429b-bff0-25adc0db1546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Created reservations ['9ee3fbe5-6be7-49e9-b761-38f4188eb219', '984a3eb1-63b7-41d2-bee7-ef47d693651f', 'be6fed1e-60eb-45b8-9b8e-a442907dd614', 'e0b364f6-6d92-4976-a289-fca479fc2fe8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Volume volume-c95940a8-62d1-4237-9e27-4c65b4905626 (c95940a8-62d1-4237-9e27-4c65b4905626): created successfully Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cffbbac-baf5-429b-bff0-25adc0db1546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (4d1b9aa6-929b-4094-8e66-424bcfc127fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c9155e98-b07d-416e-b487-87fcf9e2ffb6 tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:08:23 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:23 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:23 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:23 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:23 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.676s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:23 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d Sep 28 15:08:23 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:23 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.402s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Deleted volume successfully. Sep 28 15:08:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d98ebff8-d6b0-4d72-bf54-69ae3f8a0b58 tempest-VolumesActionsTest-931205019 None] Lock "cinder-b313c1c8-3efb-46f8-9e65-d94aa5e339cb-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:24 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" returned: 0 in 0.828s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:24 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d Sep 28 15:08:24 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-c95940a8-62d1-4237-9e27-4c65b4905626-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Lock "cinder-c95940a8-62d1-4237-9e27-4c65b4905626-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-c95940a8-62d1-4237-9e27-4c65b4905626" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-c95940a8-62d1-4237-9e27-4c65b4905626" acquired by "delete_volume" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4720c1-105a-44eb-ab60-d9c48cf68685]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:25 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 Sep 28 15:08:25 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:25 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" returned: 0 in 0.591s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-ea4aebb7-c3bf-462c-9463-b6faa7c7d77d" released by "_delete_snapshot" :: held 3.088s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" released by "delete_snapshot" :: held 3.138s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Created reservations ['c2261d9e-d8cb-4bb6-ae5f-de5091bb703a', '76e04428-6a5d-446e-995d-79d95049b2fb', 'e0ac0428-c3c7-473d-a6cc-805f44274dce', '6df2e60d-46c1-45bb-821d-a86a54bab238'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Delete snapshot completed successfully. Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1e2861dc-b033-4fdb-9861-3e39c8293a51 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-ea4aebb7-c3bf-462c-9463-b6faa7c7d77d-delete_snapshot" released by "delete_snapshot" :: held 3.521s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:25 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626" returned: 0 in 0.685s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:25 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626 Sep 28 15:08:25 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:26 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c95940a8-62d1-4237-9e27-4c65b4905626" returned: 0 in 0.390s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-c95940a8-62d1-4237-9e27-4c65b4905626" released by "delete_volume" :: held 1.158s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Created reservations ['b01a7f89-eabf-4831-9982-72e24bcf098f', 'cca03c0d-001a-4d1e-9c33-8555bdff5e5d', '3da84af0-5a6a-4a62-ac8d-1df903206a00', '04882c56-2862-402d-b8a6-452d7e834200'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:26 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:26 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:26 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.389s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:08:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-942f4007-ba09-463c-9198-0939ba8e8187 tempest-VolumesGetTest-975374711 None] Lock "cinder-c95940a8-62d1-4237-9e27-4c65b4905626-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Creating offline snapshot 521ee18c-8b8d-47ac-ab67-7518357571e7 of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aaab85-599e-4f4e-80ac-ed89c60e04e9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Lock "cinder-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:27 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:27 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c246a9-415c-4f98-bc9e-eca28725bed5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e Sep 28 15:08:27 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.708s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:28 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 1G Sep 28 15:08:28 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" returned: 0 in 0.561s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:28 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e Sep 28 15:08:28 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (db877418-2475-4ef6-9c1e-e1e000e42e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5402d8-e707-4109-a9eb-79c3b94fe7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5402d8-e707-4109-a9eb-79c3b94fe7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216618645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfde0ad-b139-4a2e-a968-77c22c0380fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:28Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59278fcd-cd8b-4014-929e-f62c8f10b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59278fcd-cd8b-4014-929e-f62c8f10b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c376558-4b1b-4a42-99a3-2bae5f1afd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c376558-4b1b-4a42-99a3-2bae5f1afd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cfde0ad-b139-4a2e-a968-77c22c0380fa', 'volume_name': 'volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed66d3b-296c-426f-a831-7a77400c6640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed66d3b-296c-426f-a831-7a77400c6640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed6d690-2fb7-478c-912e-22fcbee59732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Volume 9cfde0ad-b139-4a2e-a968-77c22c0380fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa', 'volume_size': 1} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:28 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" returned: 0 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e" released by "delete_volume" :: held 1.059s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:28 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 1G" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:28 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 Sep 28 15:08:28 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Created reservations ['24df820c-fc85-42aa-af50-105ea1706639', '86a5adfb-a7c9-43b2-816c-8f6dac43158d', '5111c8ad-3a7d-4051-bd95-2a0f0a9a150b', '3dfa0416-b909-4f06-bd2f-51662a0a68c9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dd6a22a8-cd8a-427d-8312-e2ea5ac91174 tempest-GroupsV320Test-470263291 None] Group tempest-GroupsV320Test-Group-1063877374: creating Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:28 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dd6a22a8-cd8a-427d-8312-e2ea5ac91174 tempest-GroupsV320Test-470263291 None] Group tempest-GroupsV320Test-Group-1063877374: created successfully Sep 28 15:08:28 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dd6a22a8-cd8a-427d-8312-e2ea5ac91174 tempest-GroupsV320Test-470263291 None] Create group completed successfully. Sep 28 15:08:29 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:29 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 is being set with open permissions: ugo+rw Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:29 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 Sep 28 15:08:29 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:29 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.279s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6a351be9-ced1-45d9-9f78-36cfbe689a24 tempest-VolumesGetTest-975374711 None] Lock "cinder-c16f5ff2-1e4b-4959-a620-c7f8be9daf2e-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:29 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7" returned: 0 in 0.284s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216618645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfde0ad-b139-4a2e-a968-77c22c0380fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:28Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Creating volume 9cfde0ad-b139-4a2e-a968-77c22c0380fa {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:29 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:29 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa 1073741824 Sep 28 15:08:29 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3e41b836-9e39-4c16-bbcb-0728e6137020 tempest-SnapshotsActionsTest-376606126 None] Create snapshot completed successfully Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-b52b11f0-e4fc-44be-b429-8dc0d3724292-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Lock "cinder-b52b11f0-e4fc-44be-b429-8dc0d3724292-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-b52b11f0-e4fc-44be-b429-8dc0d3724292" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-b52b11f0-e4fc-44be-b429-8dc0d3724292" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:29 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa 1073741824" returned: 0 in 0.615s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a181b9-6281-4a55-bd61-982f69ae6a8b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa Sep 28 15:08:30 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 Sep 28 15:08:30 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa" returned: 0 in 0.353s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed6d690-2fb7-478c-912e-22fcbee59732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15e6168-c8ab-46e4-926c-646ef9bb97b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:30 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Volume volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa (9cfde0ad-b139-4a2e-a968-77c22c0380fa): created successfully Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15e6168-c8ab-46e4-926c-646ef9bb97b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (db877418-2475-4ef6-9c1e-e1e000e42e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:30 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-be3404de-7b1d-49e3-a2c3-a2ed24786e15 tempest-VolumesActionsTest-931205019 None] Created volume successfully. Sep 28 15:08:30 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-521ee18c-8b8d-47ac-ab67-7518357571e7-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292" returned: 0 in 0.551s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-521ee18c-8b8d-47ac-ab67-7518357571e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:30 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292 Sep 28 15:08:30 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Acquiring lock "cinder-quobyte-521ee18c-8b8d-47ac-ab67-7518357571e7" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-521ee18c-8b8d-47ac-ab67-7518357571e7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Deleting offline snapshot 521ee18c-8b8d-47ac-ab67-7518357571e7 of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] snapshot_file for this snap is: volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[497af730-5089-4c20-9588-2b5a7e20884f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Created reservations ['6374d7da-f30a-44c0-93ac-1bb154edfe81'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:30 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 Sep 28 15:08:30 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:31 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b52b11f0-e4fc-44be-b429-8dc0d3724292" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-b52b11f0-e4fc-44be-b429-8dc0d3724292" released by "delete_volume" :: held 1.067s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Created reservations ['b96dffbb-177a-42a6-8a40-caa16f41d06f', 'a3a854a2-a743-40e1-84e8-af1758e7381b', 'c374fbe8-79bf-4351-baa6-bed1c327a1a5', '3a55827b-0f31-47a4-958a-3c5e27728810'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:31 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.305s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ede96618-f140-42aa-a268-7ab8ece6aab3 tempest-GroupsV320Test-470263291 None] Delete group completed successfully. Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:31 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:31 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:31 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7" returned: 0 in 0.555s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f6a40c-06d0-4859-8a0a-5f9f7b8c11c4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:31 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:31 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:31 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.317s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5c10e10c-62d6-4b02-9b53-f9fee248507b tempest-VolumesGetTest-975374711 None] Lock "cinder-b52b11f0-e4fc-44be-b429-8dc0d3724292-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-9cfde0ad-b139-4a2e-a968-77c22c0380fa-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-9cfde0ad-b139-4a2e-a968-77c22c0380fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-quobyte-9cfde0ad-b139-4a2e-a968-77c22c0380fa" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-9cfde0ad-b139-4a2e-a968-77c22c0380fa" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:31 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.532s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b55e2db-1672-434f-aa36-7dc53e9e5020]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:31 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 Sep 28 15:08:31 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:32 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa Sep 28 15:08:32 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:32 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa" returned: 0 in 0.582s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:32 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa Sep 28 15:08:32 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:32 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7" returned: 0 in 0.798s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:32 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7 Sep 28 15:08:32 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:32 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9cfde0ad-b139-4a2e-a968-77c22c0380fa" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-9cfde0ad-b139-4a2e-a968-77c22c0380fa" released by "delete_volume" :: held 1.137s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Created reservations ['b69e153e-8b3d-4dd0-ab7e-de19a23dc484', 'aa2ce462-31db-45a0-8f76-de7fb72c4bfc', 'f9b69514-ad7b-46cd-9c06-457d7844505c', '80a12d86-e13a-4e9a-bb17-e73ae4c7600f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:33 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.521ee18c-8b8d-47ac-ab67-7518357571e7" returned: 0 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-521ee18c-8b8d-47ac-ab67-7518357571e7" released by "_delete_snapshot" :: held 2.467s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" released by "delete_snapshot" :: held 2.512s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:33 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:33 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Created reservations ['93063f76-4e88-43cb-884a-766ac013ef6c', 'dc56d237-a8b4-41dc-a98f-e7092bbe9773', 'd582f197-9da2-428f-ba4d-11251eaea801', '6b7e9b76-62f4-4f90-b11f-f28ae1e4fce8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Delete snapshot completed successfully. Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bc29f4a0-22ac-4989-b8f4-743a1c827be0 tempest-SnapshotsActionsTest-318898668 None] Lock "cinder-521ee18c-8b8d-47ac-ab67-7518357571e7-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:33 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.361s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Deleted volume successfully. Sep 28 15:08:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-60744d4e-a543-4e9b-bc3e-5a359d0af099 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-9cfde0ad-b139-4a2e-a968-77c22c0380fa-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (8acba18b-f928-47a6-a1c3-1aefe0a4f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62bf45f-28c2-4e2a-98dd-5d8e15f3b69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62bf45f-28c2-4e2a-98dd-5d8e15f3b69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1435893076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db39a69-a7b4-4d90-9f61-19c71a891eac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea6a15-864b-4eb5-a66d-d07a55c9247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea6a15-864b-4eb5-a66d-d07a55c9247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9709b8f0-5616-4684-9758-9560f51b341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "cinder-544770c6-b8a2-4011-a829-7c736453f192-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-544770c6-b8a2-4011-a829-7c736453f192-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "cinder-quobyte-544770c6-b8a2-4011-a829-7c736453f192" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-quobyte-544770c6-b8a2-4011-a829-7c736453f192" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Deleting offline snapshot 544770c6-b8a2-4011-a829-7c736453f192 of volume f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] snapshot_file for this snap is: volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dde361-31f8-4faf-8637-87c85bbc8bdf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:35 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9709b8f0-5616-4684-9758-9560f51b341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2db39a69-a7b4-4d90-9f61-19c71a891eac', 'volume_name': 'volume-2db39a69-a7b4-4d90-9f61-19c71a891eac', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f20757-78a6-42b2-b96a-f256caa437bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f20757-78a6-42b2-b96a-f256caa437bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7208d89b-59f0-4d42-82f1-25c2ca6071eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Volume 2db39a69-a7b4-4d90-9f61-19c71a891eac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2db39a69-a7b4-4d90-9f61-19c71a891eac', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Trying to clone 2db39a69-a7b4-4d90-9f61-19c71a891eac from image c58ceb91-c951-49e6-a030-d9ed772c37aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (d493645f-6179-4319-a5ab-d190a09f33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41843aa1-3d47-4100-84ee-87c7bb56473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41843aa1-3d47-4100-84ee-87c7bb56473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-225486558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41590ea-5625-4477-9d98-bbdb7452d1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:35Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ef3345-45bd-423a-b397-68829b86d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ef3345-45bd-423a-b397-68829b86d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4240a450-de06-4103-aa95-f4fbd8ec3787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4240a450-de06-4103-aa95-f4fbd8ec3787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41590ea-5625-4477-9d98-bbdb7452d1bf', 'volume_name': 'volume-c41590ea-5625-4477-9d98-bbdb7452d1bf', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef127f-8530-4847-93bb-3db697f89a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef127f-8530-4847-93bb-3db697f89a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88b8bf9-ceb3-4de4-8c89-8bab9ea70344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Volume c41590ea-5625-4477-9d98-bbdb7452d1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41590ea-5625-4477-9d98-bbdb7452d1bf', 'volume_size': 1} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-225486558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41590ea-5625-4477-9d98-bbdb7452d1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:35Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Creating volume c41590ea-5625-4477-9d98-bbdb7452d1bf {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:35 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf 1073741824 Sep 28 15:08:35 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.755s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05e069-f7f9-4e33-affd-7153b9a1a20e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:08:35 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:08:35 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 Sep 28 15:08:35 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1341a5-d0bc-4cc2-bbb8-292320fd7088]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD Sep 28 15:08:35 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf 1073741824" returned: 0 in 0.773s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:36 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" returned: 0 in 0.718s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:36 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf Sep 28 15:08:36 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:36 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa is fetched for user 694890ce53cc4a2aa0f894d97a055336. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0371d58-72cb-4241-a051-d4d4a2f5c7d7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:36 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD Sep 28 15:08:36 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88b8bf9-ceb3-4de4-8c89-8bab9ea70344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41590ea-5625-4477-9d98-bbdb7452d1bf', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4f316-021f-4c09-98ee-88c0af0bcc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:36 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Volume volume-c41590ea-5625-4477-9d98-bbdb7452d1bf (c41590ea-5625-4477-9d98-bbdb7452d1bf): created successfully Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4f316-021f-4c09-98ee-88c0af0bcc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (d493645f-6179-4319-a5ab-d190a09f33ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-22edd492-6511-4e62-8c54-66c4ff95e723 tempest-VolumesActionsTest-931205019 None] Created volume successfully. Sep 28 15:08:36 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.539s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:36 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192 Sep 28 15:08:36 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1435893076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db39a69-a7b4-4d90-9f61-19c71a891eac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Creating volume 2db39a69-a7b4-4d90-9f61-19c71a891eac {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:37 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac 1073741824 Sep 28 15:08:37 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2.544770c6-b8a2-4011-a829-7c736453f192" returned: 0 in 0.415s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:37 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:37 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-quobyte-544770c6-b8a2-4011-a829-7c736453f192" released by "_delete_snapshot" :: held 2.669s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" released by "delete_snapshot" :: held 2.729s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Created reservations ['f9a1c95a-62fb-402c-9ff5-f195eabf8444', '3900d707-3729-429b-ad7b-f2e02c0c8fe9', '96469de8-245e-443b-9422-d6f1a00f4916', 'b8dd5c08-6357-4ee6-ab95-31954e06b8f8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-c41590ea-5625-4477-9d98-bbdb7452d1bf-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Delete snapshot completed successfully. Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b06bb0af-b3d8-45ee-8a74-74c444c1564d tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-544770c6-b8a2-4011-a829-7c736453f192-delete_snapshot" released by "delete_snapshot" :: held 3.027s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-c41590ea-5625-4477-9d98-bbdb7452d1bf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:37 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.441s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-quobyte-c41590ea-5625-4477-9d98-bbdb7452d1bf" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:37 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac 1073741824" returned: 0 in 0.814s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-c41590ea-5625-4477-9d98-bbdb7452d1bf" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1539350-8059-4520-952c-1122be07afbf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac Sep 28 15:08:37 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf Sep 28 15:08:38 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "cinder-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:38 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac" returned: 0 in 0.384s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39f8e3-9501-4530-8bf6-d3b58a625fc5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Attempting download of c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 2db39a69-a7b4-4d90-9f61-19c71a891eac. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ed8bd-5669-4ca7-b824-e90fe70c8a6b]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:38 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 Sep 28 15:08:38 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf" returned: 0 in 0.590s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:38 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf Sep 28 15:08:38 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7 Sep 28 15:08:38 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c41590ea-5625-4477-9d98-bbdb7452d1bf" returned: 0 in 0.313s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" returned: 0 in 0.497s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-c41590ea-5625-4477-9d98-bbdb7452d1bf" released by "delete_volume" :: held 0.983s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:38 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2 Sep 28 15:08:38 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Created reservations ['658860d1-1758-4287-b03e-e36b64fa588d', '6d09eb3c-9eec-43c0-937d-22e3ec5d4d2f', 'a3d368be-ac13-429b-a206-8afbfc3b1cf9', 'f2d900da-97a8-4c6f-9e8f-784d5895bb43'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:38 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7" returned: 0 in 0.503s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:39 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:39 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7 Sep 28 15:08:39 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:39 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" returned: 0 in 0.385s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-quobyte-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2" released by "delete_volume" :: held 1.005s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Created reservations ['83991998-ee40-4ae6-8fbc-dc2aac819bef', 'c1ebeada-3ff5-45e1-aa61-5645c29a29fd', '6bc08405-459f-4cb5-8afe-90d5a7cbed08', 'fef021a4-80b1-4fd3-9f3b-a05e65a8d2b6'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:39 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7" returned: 1 in 0.455s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_b5v93it7' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5eefb4-96df-44d3-8608-9095eff0835a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.383s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:39 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Deleted volume successfully. Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fa975cd-3c69-457c-9ccd-1fe0de2f8488 tempest-VolumesActionsTest-1498831149 None] Lock "cinder-c41590ea-5625-4477-9d98-bbdb7452d1bf-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:39 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD Sep 28 15:08:39 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:39 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:39 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] c58ceb91-c951-49e6-a030-d9ed772c37aa was qcow2, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.294s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:39 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Deleted volume successfully. Sep 28 15:08:39 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac Sep 28 15:08:39 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-25fc2297-ab35-44c9-86a4-714909719bf8 tempest-SnapshotsActionsTest-376606126 None] Lock "cinder-f106eaf5-70fa-4f1d-9f99-c0368b8e08c2-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (1efb7b9e-778a-40fa-a1b6-cc2d65314a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb31bb2a-c38d-4982-9217-46e996af449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb31bb2a-c38d-4982-9217-46e996af449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-513744131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:41Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088408dd-23ec-4e12-a9f0-beb9bb62035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088408dd-23ec-4e12-a9f0-beb9bb62035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d45ded2-53ca-430e-b22a-db713d900180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d45ded2-53ca-430e-b22a-db713d900180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037', 'volume_name': 'volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e28faf-a52c-41d2-9456-b4f5cc61ba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e28faf-a52c-41d2-9456-b4f5cc61ba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccd62ee-70fa-4616-aabe-941e601fe8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Volume 8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037', 'volume_size': 1} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-513744131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:41Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Creating volume 8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:40 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:41 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 1073741824 Sep 28 15:08:41 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:41 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 1073741824" returned: 0 in 0.926s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:42 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 Sep 28 15:08:42 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:42 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037" returned: 0 in 0.426s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccd62ee-70fa-4616-aabe-941e601fe8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b030879d-3920-47ff-99fe-1ff5c0db83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Volume volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 (8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037): created successfully Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b030879d-3920-47ff-99fe-1ff5c0db83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (1efb7b9e-778a-40fa-a1b6-cc2d65314a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f15e8082-e6a5-4f74-9ecf-c00ebd3d0802 tempest-VolumesActionsTest-931205019 None] Created volume successfully. Sep 28 15:08:42 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac" returned: 0 in 2.973s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_b3ljoofwdevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:08:42 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Converted 112.00 MB image at 37.66 MB/s Sep 28 15:08:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:42 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac 1G Sep 28 15:08:42 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Lock "cinder-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-quobyte-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[afac00d0-1d1c-4d7e-8f41-1512e2535050]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:43 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac 1G" returned: 0 in 0.628s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Downloaded image c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 2db39a69-a7b4-4d90-9f61-19c71a891eac successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa for user 694890ce53cc4a2aa0f894d97a055336 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Marking volume 2db39a69-a7b4-4d90-9f61-19c71a891eac as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Copying metadata from image c58ceb91-c951-49e6-a030-d9ed772c37aa to 2db39a69-a7b4-4d90-9f61-19c71a891eac. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Creating volume glance metadata for volume 2db39a69-a7b4-4d90-9f61-19c71a891eac backed by image c58ceb91-c951-49e6-a030-d9ed772c37aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:08:43 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 Sep 28 15:08:43 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7208d89b-59f0-4d42-82f1-25c2ca6071eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db39a69-a7b4-4d90-9f61-19c71a891eac', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36be751-7e13-4792-85fa-85b950891d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Volume volume-2db39a69-a7b4-4d90-9f61-19c71a891eac (2db39a69-a7b4-4d90-9f61-19c71a891eac): created successfully Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36be751-7e13-4792-85fa-85b950891d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (8acba18b-f928-47a6-a1c3-1aefe0a4f565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ea04e356-0d34-4e59-9655-850fa9207f61 tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:08:43 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037" returned: 0 in 0.541s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:43 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037 Sep 28 15:08:43 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:44 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037" returned: 0 in 0.528s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037" released by "delete_volume" :: held 1.148s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Created reservations ['b9157be1-c070-4352-8029-a451655cf29e', '2620da9c-290f-456e-ba78-ca57af254ec1', '8526d09d-cb48-4d93-8c16-995d951a98df', '5cc26a3d-4766-4410-9774-23b61c2c1d16'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:44 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:44 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:45 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.565s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Deleted volume successfully. Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dabda10c-2f60-41b6-ab45-ff4525ee95ec tempest-VolumesActionsTest-1498831149 None] Lock "cinder-8de6d63a-bb64-4a3e-ac93-a9cfa1bd8037-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (75e2dfee-6ea7-47db-aa4c-d95ec82b892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1666eede-04ca-45b1-8520-bf9c4e162776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1666eede-04ca-45b1-8520-bf9c4e162776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1625361549',display_name='tempest-VolumesGetTest-Volume-1988802603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a94112-3b24-4b26-93c9-a5b5e21288af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:45Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8946dba-6076-485d-9c44-9976d438043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8946dba-6076-485d-9c44-9976d438043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af831faa-59a7-46d6-8925-bb0a4daef3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af831faa-59a7-46d6-8925-bb0a4daef3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a94112-3b24-4b26-93c9-a5b5e21288af', 'volume_name': 'volume-18a94112-3b24-4b26-93c9-a5b5e21288af', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04e2082-8ece-4362-9991-d748ee98cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04e2082-8ece-4362-9991-d748ee98cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b847e155-76c4-49b2-bbcb-30dffc74ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Volume 18a94112-3b24-4b26-93c9-a5b5e21288af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a94112-3b24-4b26-93c9-a5b5e21288af', 'volume_size': 1} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1625361549',display_name='tempest-VolumesGetTest-Volume-1988802603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a94112-3b24-4b26-93c9-a5b5e21288af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cc367988284c5885d90d807df44969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:45Z,use_quota=True,user_id='694890ce53cc4a2aa0f894d97a055336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Creating volume 18a94112-3b24-4b26-93c9-a5b5e21288af {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:45 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:45 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af 1073741824 Sep 28 15:08:45 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:46 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af 1073741824" returned: 0 in 0.823s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af Sep 28 15:08:46 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (715a40f5-193c-4961-9620-e8f85e296030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0731f716-9162-4aad-ad20-5ca2d8c2645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0731f716-9162-4aad-ad20-5ca2d8c2645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791058444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18b7810-5b02-423e-81e3-5dabf955b508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:47Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f853a1-da5f-44da-9648-385ef98d0e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f853a1-da5f-44da-9648-385ef98d0e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f53594-49d6-4817-84da-6bf5b3ee853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f53594-49d6-4817-84da-6bf5b3ee853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18b7810-5b02-423e-81e3-5dabf955b508', 'volume_name': 'volume-a18b7810-5b02-423e-81e3-5dabf955b508', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f697c8-356f-4ca7-a551-e748c045aa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f697c8-356f-4ca7-a551-e748c045aa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b547203-3522-4181-a346-2ff98fc58a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Volume a18b7810-5b02-423e-81e3-5dabf955b508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18b7810-5b02-423e-81e3-5dabf955b508', 'volume_size': 1} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:46 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791058444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18b7810-5b02-423e-81e3-5dabf955b508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:47Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Creating volume a18b7810-5b02-423e-81e3-5dabf955b508 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:46 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 1073741824 Sep 28 15:08:46 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b847e155-76c4-49b2-bbcb-30dffc74ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a94112-3b24-4b26-93c9-a5b5e21288af', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e151ce-4684-494b-a4fa-70ef7fdf5c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Volume volume-18a94112-3b24-4b26-93c9-a5b5e21288af (18a94112-3b24-4b26-93c9-a5b5e21288af): created successfully Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e151ce-4684-494b-a4fa-70ef7fdf5c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Flow 'volume_create_manager' (75e2dfee-6ea7-47db-aa4c-d95ec82b892f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-69038dcc-b23c-4f26-8af2-d29a713460dc tempest-VolumesGetTest-975374711 None] Created volume successfully. Sep 28 15:08:47 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 1073741824" returned: 0 in 0.823s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-18a94112-3b24-4b26-93c9-a5b5e21288af-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Lock "cinder-18a94112-3b24-4b26-93c9-a5b5e21288af-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:47 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 Sep 28 15:08:47 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-18a94112-3b24-4b26-93c9-a5b5e21288af" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-18a94112-3b24-4b26-93c9-a5b5e21288af" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97d5e73-a299-49b2-86d0-89bce53e55fa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:48 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af Sep 28 15:08:48 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:48 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508" returned: 0 in 0.452s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b547203-3522-4181-a346-2ff98fc58a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18b7810-5b02-423e-81e3-5dabf955b508', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c28ff-31bc-44fa-b5fb-59cc62c3943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Volume volume-a18b7810-5b02-423e-81e3-5dabf955b508 (a18b7810-5b02-423e-81e3-5dabf955b508): created successfully Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c28ff-31bc-44fa-b5fb-59cc62c3943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (715a40f5-193c-4961-9620-e8f85e296030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8dc1f3c2-e299-4a7c-bd30-8496344d640e tempest-VolumesActionsTest-931205019 None] Created volume successfully. Sep 28 15:08:48 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af" returned: 0 in 0.609s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:48 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af Sep 28 15:08:48 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-a18b7810-5b02-423e-81e3-5dabf955b508-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Lock "cinder-a18b7810-5b02-423e-81e3-5dabf955b508-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Acquiring lock "cinder-quobyte-a18b7810-5b02-423e-81e3-5dabf955b508" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:49 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18a94112-3b24-4b26-93c9-a5b5e21288af" returned: 0 in 0.466s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-a18b7810-5b02-423e-81e3-5dabf955b508" acquired by "delete_volume" :: waited 0.045s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-18a94112-3b24-4b26-93c9-a5b5e21288af" released by "delete_volume" :: held 1.181s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[100b268f-59f7-4d8d-b5e2-94ef43e63b59]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Created reservations ['4872ed00-ba8a-4fef-b803-18a03569c0bf', 'ae7edd92-48f9-4ff4-b5de-5da427b0575b', 'a25466a3-29e6-4db1-8759-1d4ac49a464c', '64d26ade-c0eb-48bc-a534-d65a78a1dbe7'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:49 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 Sep 28 15:08:49 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:49 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508" returned: 0 in 0.618s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508 Sep 28 15:08:49 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.469s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:08:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ae39ebf7-3e59-4b82-89ef-991d78027ced tempest-VolumesGetTest-975374711 None] Lock "cinder-18a94112-3b24-4b26-93c9-a5b5e21288af-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:50 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a18b7810-5b02-423e-81e3-5dabf955b508" returned: 0 in 0.390s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Lock "cinder-quobyte-a18b7810-5b02-423e-81e3-5dabf955b508" released by "delete_volume" :: held 1.097s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Created reservations ['b92a4c8c-b476-4b31-9df4-2c2f9a3e05bb', 'e87fcbad-ab1f-4fdc-801a-2f643d4cab94', 'a8489e68-02bb-4b81-9eec-f4657c22d15d', '0198498e-bb87-49a2-95a6-61544198316b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-2db39a69-a7b4-4d90-9f61-19c71a891eac-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Lock "cinder-2db39a69-a7b4-4d90-9f61-19c71a891eac-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Acquiring lock "cinder-quobyte-2db39a69-a7b4-4d90-9f61-19c71a891eac" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:50 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:50 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-2db39a69-a7b4-4d90-9f61-19c71a891eac" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e86d15-551d-45c4-a330-6a236d4af5ab]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac Sep 28 15:08:50 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:50 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.425s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Deleted volume successfully. Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48f2d5ad-34b0-4773-883f-b9d3382f043a tempest-VolumesActionsTest-1498831149 None] Lock "cinder-a18b7810-5b02-423e-81e3-5dabf955b508-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:51 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac" returned: 0 in 0.527s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:51 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac Sep 28 15:08:51 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:51 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-2db39a69-a7b4-4d90-9f61-19c71a891eac" returned: 0 in 0.501s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Lock "cinder-quobyte-2db39a69-a7b4-4d90-9f61-19c71a891eac" released by "delete_volume" :: held 1.116s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Created reservations ['81336507-3174-4682-bf02-f45af51fee40', 'b783e236-da4b-4613-af1b-5d520b017b38', '648dad71-02df-4b60-b322-814d4f029f0e', '46c6b97e-0bc3-4371-92af-d7cfd03be2e5'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:52 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.424s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Deleted volume successfully. Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a85e27d6-bd00-4e3e-9295-bb618cca06c6 tempest-VolumesGetTest-975374711 None] Lock "cinder-2db39a69-a7b4-4d90-9f61-19c71a891eac-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (e830bc52-e0c8-4b20-a138-b58d92622e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96608165-a970-4473-847c-c9419c9127da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96608165-a970-4473-847c-c9419c9127da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420768252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3664da27-68e3-4c6c-afc7-95bcc0549af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:52Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b14ab4-12c3-4626-bd02-ca3dfc86c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b14ab4-12c3-4626-bd02-ca3dfc86c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91f02d2-e077-4f08-87a4-9835d5f28c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91f02d2-e077-4f08-87a4-9835d5f28c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3664da27-68e3-4c6c-afc7-95bcc0549af0', 'volume_name': 'volume-3664da27-68e3-4c6c-afc7-95bcc0549af0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9343dfa3-cf22-4d14-b450-95830ee79702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9343dfa3-cf22-4d14-b450-95830ee79702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2deee1-89b3-479d-a332-3db5c0d37bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Volume 3664da27-68e3-4c6c-afc7-95bcc0549af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3664da27-68e3-4c6c-afc7-95bcc0549af0', 'volume_size': 1} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420768252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3664da27-68e3-4c6c-afc7-95bcc0549af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c135acbbff404cd58ac6ec8073371d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:52Z,use_quota=True,user_id='b86066d35d8b4ec8bf715ba6e5a32a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Creating volume 3664da27-68e3-4c6c-afc7-95bcc0549af0 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:52 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:08:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 1073741824 Sep 28 15:08:52 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:53 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 1073741824" returned: 0 in 0.659s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:53 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 Sep 28 15:08:53 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:53 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0" returned: 0 in 0.371s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2deee1-89b3-479d-a332-3db5c0d37bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3664da27-68e3-4c6c-afc7-95bcc0549af0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb2739e-b3cb-407d-b43f-8393d03594bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Volume volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 (3664da27-68e3-4c6c-afc7-95bcc0549af0): created successfully Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb2739e-b3cb-407d-b43f-8393d03594bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Flow 'volume_create_manager' (e830bc52-e0c8-4b20-a138-b58d92622e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-83f867a4-a7c4-4de0-8439-3f3c80d0be2e tempest-VolumesActionsTest-931205019 None] Created volume successfully. Sep 28 15:08:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Acquiring lock "cinder-3664da27-68e3-4c6c-afc7-95bcc0549af0-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Lock "cinder-3664da27-68e3-4c6c-afc7-95bcc0549af0-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Acquiring lock "cinder-quobyte-3664da27-68e3-4c6c-afc7-95bcc0549af0" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Lock "cinder-quobyte-3664da27-68e3-4c6c-afc7-95bcc0549af0" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[677c24be-b276-4f96-a925-a38938c76200]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 Sep 28 15:08:56 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0" returned: 0 in 0.549s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0 Sep 28 15:08:56 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3664da27-68e3-4c6c-afc7-95bcc0549af0" returned: 0 in 0.407s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Lock "cinder-quobyte-3664da27-68e3-4c6c-afc7-95bcc0549af0" released by "delete_volume" :: held 1.041s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Created reservations ['46b916c8-ee73-4d08-81b5-c1b9e532521d', 'f7c75fd2-1932-4d69-abef-c3171232330e', 'c5a3f147-9cbd-4b09-8235-22b1b277dd8f', '47e530dd-b372-4e51-9911-5a70179a73c9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:57 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:08:57 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.396s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Deleted volume successfully. Sep 28 15:08:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-435fd867-98b9-45be-998d-6b331de30faf tempest-VolumesActionsTest-931205019 None] Lock "cinder-3664da27-68e3-4c6c-afc7-95bcc0549af0-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Flow 'volume_create_manager' (af3d6480-87dc-4535-b175-dab6d0820c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6626256d-8c6e-4a05-b571-23dc0a08ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6626256d-8c6e-4a05-b571-23dc0a08ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-199589376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05bf335-4af0-4459-9cc3-75482e288e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745d755e05a34b56b405238090610e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:01Z,use_quota=True,user_id='f9a9f078cc9e4d4a980582919c0dd08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd2b375-3cf3-45cc-b90c-7c1c7232b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd2b375-3cf3-45cc-b90c-7c1c7232b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fe8ee0-b940-4a09-b76c-8b9417afcc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fe8ee0-b940-4a09-b76c-8b9417afcc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05bf335-4af0-4459-9cc3-75482e288e2f', 'volume_name': 'volume-b05bf335-4af0-4459-9cc3-75482e288e2f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2fd9b3-c505-4398-a90d-d3092416f091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2fd9b3-c505-4398-a90d-d3092416f091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72181b77-67d3-407f-ab49-acdc142100f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:00 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Volume b05bf335-4af0-4459-9cc3-75482e288e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05bf335-4af0-4459-9cc3-75482e288e2f', 'volume_size': 1} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-199589376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05bf335-4af0-4459-9cc3-75482e288e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745d755e05a34b56b405238090610e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:01Z,use_quota=True,user_id='f9a9f078cc9e4d4a980582919c0dd08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Creating volume b05bf335-4af0-4459-9cc3-75482e288e2f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:00 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f 1073741824 Sep 28 15:09:00 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f 1073741824" returned: 0 in 0.765s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:01 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f Sep 28 15:09:01 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:02 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f" returned: 0 in 0.421s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72181b77-67d3-407f-ab49-acdc142100f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05bf335-4af0-4459-9cc3-75482e288e2f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed2247a-9e9d-424c-8132-9637cc655d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Volume volume-b05bf335-4af0-4459-9cc3-75482e288e2f (b05bf335-4af0-4459-9cc3-75482e288e2f): created successfully Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed2247a-9e9d-424c-8132-9637cc655d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Flow 'volume_create_manager' (af3d6480-87dc-4535-b175-dab6d0820c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ad2142ca-eaff-40e8-a2dd-d55ce16f8e7f tempest-VolumesNegativeTest-1938869293 None] Created volume successfully. Sep 28 15:09:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=152,cinder:INSERT=42,cinder:SELECT=112,cinder:DELETE=12 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=159,cinder:SELECT=129,cinder:DELETE=13,cinder:INSERT=45 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Flow 'volume_create_manager' (4636e555-57c0-4c1e-8fcf-d9474cca2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d79a485-d931-46f6-90ae-06047a55aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d79a485-d931-46f6-90ae-06047a55aa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1081235827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a44402c-592f-48cb-a203-574409be79c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a00d28ffff42a3ac8a1b39fdeb37d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:18Z,use_quota=True,user_id='87b1232582264427afe5c4c84d7966a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d8d28e-8c81-4757-9bf5-6f4a431bfb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d8d28e-8c81-4757-9bf5-6f4a431bfb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efccfc1a-369a-4d1a-a396-c4c917f6b734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efccfc1a-369a-4d1a-a396-c4c917f6b734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a44402c-592f-48cb-a203-574409be79c8', 'volume_name': 'volume-0a44402c-592f-48cb-a203-574409be79c8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03259e8-6c3e-4ac5-a65a-569be2c4ea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03259e8-6c3e-4ac5-a65a-569be2c4ea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f365960e-d596-4884-915a-0806f1caf5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Volume 0a44402c-592f-48cb-a203-574409be79c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a44402c-592f-48cb-a203-574409be79c8', 'volume_size': 1} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1081235827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a44402c-592f-48cb-a203-574409be79c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a00d28ffff42a3ac8a1b39fdeb37d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:18Z,use_quota=True,user_id='87b1232582264427afe5c4c84d7966a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Creating volume 0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:17 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 1073741824 Sep 28 15:09:17 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 1073741824" returned: 0 in 0.830s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 Sep 28 15:09:18 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8" returned: 0 in 0.364s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f365960e-d596-4884-915a-0806f1caf5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a44402c-592f-48cb-a203-574409be79c8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474bcd7f-bd05-4b37-97ab-84068a86153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:19 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Volume volume-0a44402c-592f-48cb-a203-574409be79c8 (0a44402c-592f-48cb-a203-574409be79c8): created successfully Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474bcd7f-bd05-4b37-97ab-84068a86153b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Flow 'volume_create_manager' (4636e555-57c0-4c1e-8fcf-d9474cca2aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-acfaa2f6-f3aa-4998-806f-dc729fe81b9e tempest-SnapshotMetadataTestJSON-41035793 None] Created volume successfully. Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Creating offline snapshot 4fed7666-a3c6-419b-967b-723e565c23f4 of volume 0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b6187-e62e-4739-9078-0cf7bb0122fb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 Sep 28 15:09:20 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8" returned: 0 in 0.606s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 1G Sep 28 15:09:20 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 1G" returned: 0 in 0.820s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a44402c-592f-48cb-a203-574409be79c8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:21 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a44402c-592f-48cb-a203-574409be79c8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 Sep 28 15:09:21 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:22 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a44402c-592f-48cb-a203-574409be79c8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4" returned: 0 in 0.458s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:22 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 is being set with open permissions: ugo+rw Sep 28 15:09:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:22 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 Sep 28 15:09:22 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:22 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4" returned: 0 in 0.456s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:22 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info Sep 28 15:09:22 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:23 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info" returned: 0 in 0.617s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:23 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info is being set with open permissions: ugo+rw Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:23 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info Sep 28 15:09:23 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Flow 'volume_create_manager' (6754f973-9dc6-4b3d-9929-dd5e743b20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b22dea5-7067-4e0c-8e5a-f251d16e34ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b22dea5-7067-4e0c-8e5a-f251d16e34ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1910269708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07355f0e-ee07-47a4-828d-b8c544401caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da29b75f49a94257bd55805d775536e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:23Z,use_quota=True,user_id='a4862ae5047044f680907ffcece6cb00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e588f7-5568-4ad7-a468-8f80a9b3aef8),volume_type_id=d8e588f7-5568-4ad7-a468-8f80a9b3aef8)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c07ce5e-f3e0-4b80-a1e6-a88aebbc7013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c07ce5e-f3e0-4b80-a1e6-a88aebbc7013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81dbd7d-ef44-4877-a3b0-9579f4d1ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81dbd7d-ef44-4877-a3b0-9579f4d1ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07355f0e-ee07-47a4-828d-b8c544401caa', 'volume_name': 'volume-07355f0e-ee07-47a4-828d-b8c544401caa', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8525e75c-efd2-4652-b2c2-4a8bc8f538a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8525e75c-efd2-4652-b2c2-4a8bc8f538a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e841d92-3f14-4326-8577-581fac52d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Volume 07355f0e-ee07-47a4-828d-b8c544401caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07355f0e-ee07-47a4-828d-b8c544401caa', 'volume_size': 1} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:23 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.info" returned: 0 in 0.475s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.640s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1910269708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07355f0e-ee07-47a4-828d-b8c544401caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da29b75f49a94257bd55805d775536e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:23Z,use_quota=True,user_id='a4862ae5047044f680907ffcece6cb00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e588f7-5568-4ad7-a468-8f80a9b3aef8),volume_type_id=d8e588f7-5568-4ad7-a468-8f80a9b3aef8)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Creating volume 07355f0e-ee07-47a4-828d-b8c544401caa {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:23 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:23 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa 1073741824 Sep 28 15:09:23 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5cdd21a8-86c1-4fad-a226-2de618c5f470 tempest-SnapshotMetadataTestJSON-41035793 None] Create snapshot completed successfully Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Flow 'volume_create_manager' (895fee6d-cef7-4a82-9f06-237d4c958af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5e9f04-7341-4994-b460-37bfe1c5a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5e9f04-7341-4994-b460-37bfe1c5a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-473147806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7e74e9-6657-4eed-8ab5-0063c2e5914f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f846cdebe97e479d9c69e6412aff4a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:24Z,use_quota=True,user_id='b384e42213e54bbdb0f1e19ae00a9704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdc636c-bb7d-4604-903f-cd2bc3dd0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdc636c-bb7d-4604-903f-cd2bc3dd0a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a261bf-8596-4944-acf0-2888bca42817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a261bf-8596-4944-acf0-2888bca42817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce7e74e9-6657-4eed-8ab5-0063c2e5914f', 'volume_name': 'volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073165ab-70fa-4c06-99e7-d0a82695e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073165ab-70fa-4c06-99e7-d0a82695e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a094f9-ea95-4136-9b93-e2d4bc267747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:24 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Volume ce7e74e9-6657-4eed-8ab5-0063c2e5914f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Trying to clone ce7e74e9-6657-4eed-8ab5-0063c2e5914f from image c58ceb91-c951-49e6-a030-d9ed772c37aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:09:24 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa 1073741824" returned: 0 in 0.825s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:24 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa Sep 28 15:09:24 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:09:25 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:09:25 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa" returned: 0 in 0.444s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e841d92-3f14-4326-8577-581fac52d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07355f0e-ee07-47a4-828d-b8c544401caa', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047cbf3e-3f1f-4547-9af5-217caf8d5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:25 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Volume volume-07355f0e-ee07-47a4-828d-b8c544401caa (07355f0e-ee07-47a4-828d-b8c544401caa): created successfully Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047cbf3e-3f1f-4547-9af5-217caf8d5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Flow 'volume_create_manager' (6754f973-9dc6-4b3d-9929-dd5e743b20b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2117257-70e1-4094-be76-97dd098726ec]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b7d0970b-a9a4-45fa-8f98-33e66c1f1b32 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Created volume successfully. Sep 28 15:09:25 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD Sep 28 15:09:25 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:25 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa is fetched for user b384e42213e54bbdb0f1e19ae00a9704. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48448c4-544a-498f-aa22-59fab717e37e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "cinder-4fed7666-a3c6-419b-967b-723e565c23f4-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-4fed7666-a3c6-419b-967b-723e565c23f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "cinder-quobyte-0a44402c-592f-48cb-a203-574409be79c8" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-quobyte-0a44402c-592f-48cb-a203-574409be79c8" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "cinder-quobyte-4fed7666-a3c6-419b-967b-723e565c23f4" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:26 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD Sep 28 15:09:26 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-quobyte-4fed7666-a3c6-419b-967b-723e565c23f4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Deleting offline snapshot 4fed7666-a3c6-419b-967b-723e565c23f4 of volume 0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] snapshot_file for this snap is: volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b17bbc-70cc-4217-b15d-9938c9fa50b1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:26 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 Sep 28 15:09:26 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD" returned: 0 in 0.513s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-473147806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7e74e9-6657-4eed-8ab5-0063c2e5914f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f846cdebe97e479d9c69e6412aff4a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:24Z,use_quota=True,user_id='b384e42213e54bbdb0f1e19ae00a9704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Creating volume ce7e74e9-6657-4eed-8ab5-0063c2e5914f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:26 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f 1073741824 Sep 28 15:09:26 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.325s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c81a9d71-ae52-4525-9749-451e33585489 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Retype volume completed successfully. Sep 28 15:09:26 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4" returned: 0 in 0.518s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a44402c-592f-48cb-a203-574409be79c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3161e06-5483-4b93-bd48-d758a1c2c819]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 Sep 28 15:09:26 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:27 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f 1073741824" returned: 0 in 0.637s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:27 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f Sep 28 15:09:27 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:27 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8" returned: 0 in 0.556s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:27 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 Sep 28 15:09:27 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Acquiring lock "cinder-07355f0e-ee07-47a4-828d-b8c544401caa-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "cinder-07355f0e-ee07-47a4-828d-b8c544401caa-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Acquiring lock "cinder-quobyte-07355f0e-ee07-47a4-828d-b8c544401caa" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "cinder-quobyte-07355f0e-ee07-47a4-828d-b8c544401caa" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:27 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" returned: 0 in 0.433s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c788f26-1689-4b40-98ed-c35f987b4688]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Attempting download of c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume ce7e74e9-6657-4eed-8ab5-0063c2e5914f. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b39dc5-a1a5-46c7-a19f-19da391d360f]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:27 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa Sep 28 15:09:27 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:27 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr Sep 28 15:09:27 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:27 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4" returned: 0 in 0.581s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:27 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4 Sep 28 15:09:27 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:28 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa" returned: 0 in 0.545s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:28 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa Sep 28 15:09:28 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:28 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8.4fed7666-a3c6-419b-967b-723e565c23f4" returned: 0 in 0.359s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:28 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr" returned: 0 in 0.579s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-quobyte-4fed7666-a3c6-419b-967b-723e565c23f4" released by "_delete_snapshot" :: held 2.231s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-quobyte-0a44402c-592f-48cb-a203-574409be79c8" released by "delete_snapshot" :: held 2.275s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:28 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr Sep 28 15:09:28 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Created reservations ['e440b3f5-0860-481f-ba75-6ba0f339c4db', '0981d1c7-fcc2-4be0-beb7-47c21c81bfac', '8fa3d2d5-5564-4d7d-8fb8-e9124883887e', '06ac8dce-fe7b-45cd-8d53-d3ec0d57a75e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Delete snapshot completed successfully. Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c15c4db5-1a3e-4671-ae7f-66b87d973ee2 tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-4fed7666-a3c6-419b-967b-723e565c23f4-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:28 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-07355f0e-ee07-47a4-828d-b8c544401caa" returned: 0 in 0.501s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "cinder-quobyte-07355f0e-ee07-47a4-828d-b8c544401caa" released by "delete_volume" :: held 1.112s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:28 devstack cinder-volume[87124]: WARNING cinder.quota [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:28 devstack cinder-volume[87124]: WARNING cinder.quota [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Created reservations ['4b15a84d-1222-47dd-bd34-e3a9fc63547b', '393d0d6d-7b6b-4f70-96b0-6851db38689e', '95ed98e9-d88d-4b3d-910d-110331d846e4', '4d177911-d7d0-431f-9fc3-d81b3b971eea'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:28 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:28 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:28 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr" returned: 1 in 0.623s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_zvms3wbr' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002bd5a-a38a-4a95-a3b2-954c56c845d7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:29 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD Sep 28 15:09:29 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:29 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.355s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Deleted volume successfully. Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-51a14d11-4327-4f8f-865b-bc477aca28c6 tempest-VolumeRetypeWithoutMigrationTest-1569602371 None] Lock "cinder-07355f0e-ee07-47a4-828d-b8c544401caa-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "cinder-0a44402c-592f-48cb-a203-574409be79c8-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-0a44402c-592f-48cb-a203-574409be79c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:29 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] c58ceb91-c951-49e6-a030-d9ed772c37aa was qcow2, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:29 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f Sep 28 15:09:29 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "cinder-quobyte-0a44402c-592f-48cb-a203-574409be79c8" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-quobyte-0a44402c-592f-48cb-a203-574409be79c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a468e1fb-9b0a-4e5f-a52c-010cad3a1a12]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:29 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 Sep 28 15:09:29 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:30 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8" returned: 0 in 0.551s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:30 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8 Sep 28 15:09:30 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:30 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a44402c-592f-48cb-a203-574409be79c8" returned: 0 in 0.460s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-quobyte-0a44402c-592f-48cb-a203-574409be79c8" released by "delete_volume" :: held 1.136s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Created reservations ['90858557-144c-41c9-a2db-dbd470f7b831', '65c60c35-b82e-4e68-b85e-c8e434a9863b', '75487e0f-0c39-4999-b4ef-5fde7f5a6950', '242deb54-73af-46df-b3d3-f37c00e19410'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:30 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:30 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:31 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.339s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:31 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Deleted volume successfully. Sep 28 15:09:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e5567143-4dbc-4a34-ac42-14a254222c2d tempest-SnapshotMetadataTestJSON-41035793 None] Lock "cinder-0a44402c-592f-48cb-a203-574409be79c8-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:32 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" returned: 0 in 3.004s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_8o84wc58devstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:09:32 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Converted 112.00 MB image at 37.27 MB/s Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:32 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f 1G Sep 28 15:09:32 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:32 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f 1G" returned: 0 in 0.541s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Downloaded image c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume ce7e74e9-6657-4eed-8ab5-0063c2e5914f successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa for user b384e42213e54bbdb0f1e19ae00a9704 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:09:32 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Marking volume ce7e74e9-6657-4eed-8ab5-0063c2e5914f as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:09:33 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Copying metadata from image c58ceb91-c951-49e6-a030-d9ed772c37aa to ce7e74e9-6657-4eed-8ab5-0063c2e5914f. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:09:33 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Creating volume glance metadata for volume ce7e74e9-6657-4eed-8ab5-0063c2e5914f backed by image c58ceb91-c951-49e6-a030-d9ed772c37aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:09:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a094f9-ea95-4136-9b93-e2d4bc267747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2b5f36-57fc-4c86-95f6-73dd468eeffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Volume volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f (ce7e74e9-6657-4eed-8ab5-0063c2e5914f): created successfully Sep 28 15:09:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2b5f36-57fc-4c86-95f6-73dd468eeffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Flow 'volume_create_manager' (895fee6d-cef7-4a82-9f06-237d4c958af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b584d8a0-f4df-4914-a774-648fc1d263ad tempest-VolumesImageMetadata-994210069 None] Created volume successfully. Sep 28 15:09:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Acquiring lock "cinder-ce7e74e9-6657-4eed-8ab5-0063c2e5914f-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Lock "cinder-ce7e74e9-6657-4eed-8ab5-0063c2e5914f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Acquiring lock "cinder-quobyte-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Lock "cinder-quobyte-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4ca1f-96c0-4a12-afeb-47417e5dda71]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:35 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f Sep 28 15:09:35 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" returned: 0 in 0.616s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f Sep 28 15:09:36 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Acquiring lock "cinder-b05bf335-4af0-4459-9cc3-75482e288e2f-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Lock "cinder-b05bf335-4af0-4459-9cc3-75482e288e2f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Acquiring lock "cinder-quobyte-b05bf335-4af0-4459-9cc3-75482e288e2f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Lock "cinder-quobyte-b05bf335-4af0-4459-9cc3-75482e288e2f" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054b954-c02b-4433-a520-c3ea933adc9a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" returned: 0 in 0.414s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Lock "cinder-quobyte-ce7e74e9-6657-4eed-8ab5-0063c2e5914f" released by "delete_volume" :: held 1.107s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:36 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f Sep 28 15:09:36 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Created reservations ['5525f3eb-1d15-42d4-bca8-4cda9997b434', '5d2d4d9f-72ee-4939-b752-34c84eb4d66b', '108e8dbf-3105-49a5-a3ee-80f46d023c10', '427c9678-296f-454c-984f-4a37df0b9888'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:36 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f" returned: 0 in 0.651s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f Sep 28 15:09:37 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.400s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Deleted volume successfully. Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-241111ea-ee16-41f2-af5b-68097235b16b tempest-VolumesImageMetadata-994210069 None] Lock "cinder-ce7e74e9-6657-4eed-8ab5-0063c2e5914f-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b05bf335-4af0-4459-9cc3-75482e288e2f" returned: 0 in 0.366s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:37 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Lock "cinder-quobyte-b05bf335-4af0-4459-9cc3-75482e288e2f" released by "delete_volume" :: held 1.099s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Created reservations ['443d532f-e814-4268-9c54-bb424d9fb110', '4e437c5f-f6b4-4ae8-8249-b49d7add6dba', 'e39385ad-86c5-4961-91f6-e1088dccfbe7', '3c0d7edb-3a40-45fe-b312-63f54d6b16e6'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:37 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.384s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:09:37 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.338s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Deleted volume successfully. Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a69e54f6-705a-46e7-bbb4-0c30f02dcb1c tempest-VolumesNegativeTest-1938869293 None] Lock "cinder-b05bf335-4af0-4459-9cc3-75482e288e2f-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Flow 'volume_create_manager' (80cd8bde-11c9-4632-ab4a-a9a376c80ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcf9552-b66c-46e6-bb9f-fb32303d26a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcf9552-b66c-46e6-bb9f-fb32303d26a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-163091805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412e31bf-0537-47ca-a1ce-d046710a4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a4907117b649bebf492564b2e1d2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:38Z,use_quota=True,user_id='de91a1b47f9447b0bc9f358943240deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58551198-474f-49ec-be58-cc2f0d4a185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58551198-474f-49ec-be58-cc2f0d4a185e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e56a9f-9769-437f-923d-f5cad6cd5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e56a9f-9769-437f-923d-f5cad6cd5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412e31bf-0537-47ca-a1ce-d046710a4730', 'volume_name': 'volume-412e31bf-0537-47ca-a1ce-d046710a4730', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d05b0a-b73b-4b91-bc42-9b6b56823ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d05b0a-b73b-4b91-bc42-9b6b56823ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c403a6-5601-4f03-97bb-7cdfc23b1f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Volume 412e31bf-0537-47ca-a1ce-d046710a4730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412e31bf-0537-47ca-a1ce-d046710a4730', 'volume_size': 1} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-163091805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412e31bf-0537-47ca-a1ce-d046710a4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a4907117b649bebf492564b2e1d2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:38Z,use_quota=True,user_id='de91a1b47f9447b0bc9f358943240deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Creating volume 412e31bf-0537-47ca-a1ce-d046710a4730 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:38 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:38 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 1073741824 Sep 28 15:09:38 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:39 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 1073741824" returned: 0 in 0.761s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:39 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 Sep 28 15:09:39 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:39 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730" returned: 0 in 0.356s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c403a6-5601-4f03-97bb-7cdfc23b1f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412e31bf-0537-47ca-a1ce-d046710a4730', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6bc04-0320-46aa-bad8-bdc756b455dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:39 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Volume volume-412e31bf-0537-47ca-a1ce-d046710a4730 (412e31bf-0537-47ca-a1ce-d046710a4730): created successfully Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6bc04-0320-46aa-bad8-bdc756b455dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Flow 'volume_create_manager' (80cd8bde-11c9-4632-ab4a-a9a376c80ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-be75aa58-4510-4f17-aa0b-a2b3bba7a0a2 tempest-VolumesMetadataTest-1167362355 None] Created volume successfully. Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Flow 'volume_create_manager' (2b341d8e-a973-42b3-ba56-b444acd60cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec687d6c-df83-4d6d-be3b-0dda9096b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec687d6c-df83-4d6d-be3b-0dda9096b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178646299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca07b31-5dbf-4d1b-8db5-be00d6224fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155a2c849eb48839fc11ff84d3e854a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:41Z,use_quota=True,user_id='bb4a64d08e0b4f82b9312cf0df1ccf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67b481c-8823-41f8-882a-92f03d6c7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67b481c-8823-41f8-882a-92f03d6c7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2b494c-5fbb-4ebc-ac6a-20a12fe50f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2b494c-5fbb-4ebc-ac6a-20a12fe50f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca07b31-5dbf-4d1b-8db5-be00d6224fcb', 'volume_name': 'volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce371b21-81ce-447a-baed-c68e3f17fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce371b21-81ce-447a-baed-c68e3f17fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5b325d-e48a-4f49-b1c8-70ff8b936371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Volume bca07b31-5dbf-4d1b-8db5-be00d6224fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb', 'volume_size': 1} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178646299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca07b31-5dbf-4d1b-8db5-be00d6224fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155a2c849eb48839fc11ff84d3e854a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:41Z,use_quota=True,user_id='bb4a64d08e0b4f82b9312cf0df1ccf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Creating volume bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:41 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:41 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb 1073741824 Sep 28 15:09:41 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:42 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb 1073741824" returned: 0 in 0.763s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:42 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb Sep 28 15:09:42 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Acquiring lock "cinder-412e31bf-0537-47ca-a1ce-d046710a4730-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Lock "cinder-412e31bf-0537-47ca-a1ce-d046710a4730-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Acquiring lock "cinder-quobyte-412e31bf-0537-47ca-a1ce-d046710a4730" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Lock "cinder-quobyte-412e31bf-0537-47ca-a1ce-d046710a4730" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8fe5b9-7dd1-4e82-a8e1-fbea12fdf065]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:42 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 Sep 28 15:09:42 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:42 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" returned: 0 in 0.497s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5b325d-e48a-4f49-b1c8-70ff8b936371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caecc5ee-90cf-40d8-9f7c-d04d5024976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Volume volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb (bca07b31-5dbf-4d1b-8db5-be00d6224fcb): created successfully Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caecc5ee-90cf-40d8-9f7c-d04d5024976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Flow 'volume_create_manager' (2b341d8e-a973-42b3-ba56-b444acd60cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-148d5509-7934-4da9-b28b-b5021ad6a704 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Created volume successfully. Sep 28 15:09:43 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730" returned: 0 in 0.636s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:43 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730 Sep 28 15:09:43 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:43 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-412e31bf-0537-47ca-a1ce-d046710a4730" returned: 0 in 0.320s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Lock "cinder-quobyte-412e31bf-0537-47ca-a1ce-d046710a4730" released by "delete_volume" :: held 1.042s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Created reservations ['b9e251c8-9854-4854-82fd-15646f924a44', '7178e049-8b21-4adb-bd95-2265f235b2ea', 'fa57d535-1625-4640-a1b8-a88c40c5c1a6', 'cf0d8f06-07a1-4ddb-96ca-ee7cfa71fdac'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:43 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:43 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Creating offline snapshot fef200ed-2cca-4005-839d-bd6ec71b55b9 of volume bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a151a-08e8-4006-b4ac-d00f7e65a40e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:44 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.419s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:44 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Deleted volume successfully. Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-673729eb-6b56-4c6a-b0f1-64e5f2bfa171 tempest-VolumesMetadataTest-1167362355 None] Lock "cinder-412e31bf-0537-47ca-a1ce-d046710a4730-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:44 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb Sep 28 15:09:44 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:44 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" returned: 0 in 0.694s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:44 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 1G Sep 28 15:09:44 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Flow 'volume_create_manager' (99e34eef-42c6-4f3e-9414-93344978e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fd98a1-1fdd-4f7a-84e4-29041c4f30eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fd98a1-1fdd-4f7a-84e4-29041c4f30eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-58180115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ba299-cd9f-4bb5-b8e0-5648f669e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433bcef37f4c42e889a65259ece10f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:45Z,use_quota=True,user_id='6dffda3e6e2f4294a1bb4b45693ab55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5021a2-982f-4ada-8399-4f93af23bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5021a2-982f-4ada-8399-4f93af23bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670de08c-b60f-4c72-9622-f9ed8ef8f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670de08c-b60f-4c72-9622-f9ed8ef8f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54ba299-cd9f-4bb5-b8e0-5648f669e2a2', 'volume_name': 'volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2', 'volume_size': 2}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7590b1-568e-4960-9093-51468811a5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7590b1-568e-4960-9093-51468811a5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fb3956-ed70-4cd9-ac5c-27d7230241c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Volume b54ba299-cd9f-4bb5-b8e0-5648f669e2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2', 'volume_size': 2} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:45 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 1G" returned: 0 in 0.772s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:45 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 Sep 28 15:09:45 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:45 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9" returned: 0 in 0.477s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:45 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 is being set with open permissions: ugo+rw Sep 28 15:09:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:46 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 Sep 28 15:09:46 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:46 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9" returned: 0 in 0.380s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:46 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info Sep 28 15:09:46 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:46 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info" returned: 0 in 0.318s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:46 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info is being set with open permissions: ugo+rw Sep 28 15:09:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:46 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info Sep 28 15:09:46 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:47 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.info" returned: 0 in 0.278s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-58180115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ba299-cd9f-4bb5-b8e0-5648f669e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433bcef37f4c42e889a65259ece10f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:45Z,use_quota=True,user_id='6dffda3e6e2f4294a1bb4b45693ab55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Creating volume b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:47 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 2147483648 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:47 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 2147483648 Sep 28 15:09:47 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c50d612a-6ca9-46a0-826a-a38ad1a74125 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Create snapshot completed successfully Sep 28 15:09:47 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 2147483648" returned: 0 in 0.687s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:47 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 Sep 28 15:09:47 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:48 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" returned: 0 in 0.298s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fb3956-ed70-4cd9-ac5c-27d7230241c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2', 'volume_size': 2}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a75c56-6bb7-43f9-8239-e639c9b0e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Volume volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 (b54ba299-cd9f-4bb5-b8e0-5648f669e2a2): created successfully Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a75c56-6bb7-43f9-8239-e639c9b0e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Flow 'volume_create_manager' (99e34eef-42c6-4f3e-9414-93344978e155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6e42da87-089f-4dd7-b79b-40ae9e02dfa6 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Created volume successfully. Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Creating offline snapshot 2261e6ee-f9bd-489c-b9ba-8888c2b001b0 of volume b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[578bb708-ad39-495e-aed2-487170fa3c7f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:49 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 Sep 28 15:09:49 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "cinder-fef200ed-2cca-4005-839d-bd6ec71b55b9-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-fef200ed-2cca-4005-839d-bd6ec71b55b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "cinder-quobyte-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-quobyte-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "cinder-quobyte-fef200ed-2cca-4005-839d-bd6ec71b55b9" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-quobyte-fef200ed-2cca-4005-839d-bd6ec71b55b9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Deleting offline snapshot fef200ed-2cca-4005-839d-bd6ec71b55b9 of volume bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] snapshot_file for this snap is: volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca040b-cae1-4dcc-a156-7691d1eb7462]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:49 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" returned: 0 in 0.583s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 2G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:49 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 2G Sep 28 15:09:49 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:49 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 Sep 28 15:09:49 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:49 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Flow 'volume_create_manager' (73b936c3-e9a8-4e87-b256-5fcfe30805b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a93ed0-bd27-4727-a285-ecb1706a7232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9" returned: 0 in 0.544s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a93ed0-bd27-4727-a285-ecb1706a7232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1678608837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30764c96-4e00-421c-8f5e-9511e2d33592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9c15262a3644e495d57cc6ea8a4d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:50Z,use_quota=True,user_id='2f002fbcdd0c43fba21995ae6b2e243f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f39ada-e0bc-4673-b9b2-28e9a26eecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f39ada-e0bc-4673-b9b2-28e9a26eecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d26431-d119-47f8-9fbb-674d6f9b3083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d26431-d119-47f8-9fbb-674d6f9b3083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30764c96-4e00-421c-8f5e-9511e2d33592', 'volume_name': 'volume-30764c96-4e00-421c-8f5e-9511e2d33592', 'volume_size': 2}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff671f69-f433-4eb8-ae85-0225a2c12905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff671f69-f433-4eb8-ae85-0225a2c12905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2876a71-6738-49f6-aad4-d6d84329b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:49 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Volume 30764c96-4e00-421c-8f5e-9511e2d33592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30764c96-4e00-421c-8f5e-9511e2d33592', 'volume_size': 2} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d587df9a-6995-4199-94c3-6fcd2559ad21]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:50 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb Sep 28 15:09:50 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:50 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 2G" returned: 0 in 0.753s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:50 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 Sep 28 15:09:50 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:50 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" returned: 0 in 0.573s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:50 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 Sep 28 15:09:50 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:50 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0" returned: 0 in 0.453s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:50 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 is being set with open permissions: ugo+rw Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:50 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 Sep 28 15:09:50 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:50 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0" returned: 0 in 0.315s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:51 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info Sep 28 15:09:51 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:51 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9" returned: 0 in 0.548s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:51 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9 Sep 28 15:09:51 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:51 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info" returned: 0 in 0.357s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info is being set with open permissions: ugo+rw Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:51 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info Sep 28 15:09:51 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:51 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb.fef200ed-2cca-4005-839d-bd6ec71b55b9" returned: 0 in 0.382s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Flow 'volume_create_manager' (e8a0eca3-b092-4f4d-b25c-4a9bc8359fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f81668-48d5-4f2b-a23f-7f72a01363c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-quobyte-fef200ed-2cca-4005-839d-bd6ec71b55b9" released by "_delete_snapshot" :: held 2.322s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-quobyte-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" released by "delete_snapshot" :: held 2.368s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f81668-48d5-4f2b-a23f-7f72a01363c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-355665886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c226a98a-fc94-4192-aa85-50a829eda321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab61f7c43c1e488287b51a389ad7acc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:51Z,use_quota=True,user_id='fabef6acdb3e4bbd826ce7b22a24afe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be599c5d-4e65-4cf3-9d82-e331a00ea079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be599c5d-4e65-4cf3-9d82-e331a00ea079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07080c1-449b-4305-9ba9-7fd50f09015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07080c1-449b-4305-9ba9-7fd50f09015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c226a98a-fc94-4192-aa85-50a829eda321', 'volume_name': 'volume-c226a98a-fc94-4192-aa85-50a829eda321', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c6273c-3bc6-4661-886d-5d6e3b4abdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c6273c-3bc6-4661-886d-5d6e3b4abdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8ae03e-9dd2-4278-9ad8-7f528bcc9f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Volume c226a98a-fc94-4192-aa85-50a829eda321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c226a98a-fc94-4192-aa85-50a829eda321', 'volume_size': 1} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Created reservations ['a6e7f964-b829-4a22-b142-b092d5ca4510', '5d7bbd2f-fce5-4403-b397-6d59d092f55f', '8f46396c-cb9b-4531-a58c-17c270003ef8', 'df44e109-c0e6-4b67-986e-20e93dcad7a9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:51 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.info" returned: 0 in 0.368s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1678608837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30764c96-4e00-421c-8f5e-9511e2d33592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9c15262a3644e495d57cc6ea8a4d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:50Z,use_quota=True,user_id='2f002fbcdd0c43fba21995ae6b2e243f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Creating volume 30764c96-4e00-421c-8f5e-9511e2d33592 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:51 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 2147483648 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:51 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 2147483648 Sep 28 15:09:51 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6740e3e4-8340-445f-8c68-37f67c925fc2 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Create snapshot completed successfully Sep 28 15:09:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Delete snapshot completed successfully. Sep 28 15:09:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-04844984-a9dc-4b10-a54f-504aa1260308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-fef200ed-2cca-4005-839d-bd6ec71b55b9-delete_snapshot" released by "delete_snapshot" :: held 2.705s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "cinder-2261e6ee-f9bd-489c-b9ba-8888c2b001b0-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-2261e6ee-f9bd-489c-b9ba-8888c2b001b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "cinder-quobyte-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-quobyte-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "cinder-quobyte-2261e6ee-f9bd-489c-b9ba-8888c2b001b0" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-quobyte-2261e6ee-f9bd-489c-b9ba-8888c2b001b0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Deleting offline snapshot 2261e6ee-f9bd-489c-b9ba-8888c2b001b0 of volume b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] snapshot_file for this snap is: volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc615196-a65b-480b-bbba-d23d1646acf4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:52 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 2147483648" returned: 0 in 0.752s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:52 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 Sep 28 15:09:52 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "cinder-bca07b31-5dbf-4d1b-8db5-be00d6224fcb-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-bca07b31-5dbf-4d1b-8db5-be00d6224fcb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:52 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 Sep 28 15:09:52 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "cinder-quobyte-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-quobyte-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7517b59c-bd0d-40c9-827c-002205275d79]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:52 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb Sep 28 15:09:52 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:52 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0" returned: 0 in 0.518s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05e17c-6662-4f75-ba63-8f5a582d173f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:52 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592" returned: 0 in 0.386s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-355665886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c226a98a-fc94-4192-aa85-50a829eda321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab61f7c43c1e488287b51a389ad7acc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:51Z,use_quota=True,user_id='fabef6acdb3e4bbd826ce7b22a24afe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Creating volume c226a98a-fc94-4192-aa85-50a829eda321 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:53 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2876a71-6738-49f6-aad4-d6d84329b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30764c96-4e00-421c-8f5e-9511e2d33592', 'volume_size': 2}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:53 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 1073741824 Sep 28 15:09:53 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99053a16-3961-4ce8-bc4e-531b775e7897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Volume volume-30764c96-4e00-421c-8f5e-9511e2d33592 (30764c96-4e00-421c-8f5e-9511e2d33592): created successfully Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99053a16-3961-4ce8-bc4e-531b775e7897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Flow 'volume_create_manager' (73b936c3-e9a8-4e87-b256-5fcfe30805b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-aa3fd8d7-4be2-4d91-80c1-07932cf479cb tempest-VolumesCloneNegativeTest-1084501603 None] Created volume successfully. Sep 28 15:09:53 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 Sep 28 15:09:53 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:53 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" returned: 0 in 0.532s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb Sep 28 15:09:53 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:53 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" returned: 0 in 0.464s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 Sep 28 15:09:53 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:53 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" returned: 0 in 0.346s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-quobyte-bca07b31-5dbf-4d1b-8db5-be00d6224fcb" released by "delete_volume" :: held 0.970s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:53 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 1073741824" returned: 0 in 0.700s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Created reservations ['b9196b43-46e8-4bfc-9029-726b0c411536', '636983b4-d09d-4915-9333-836cd21850bd', 'c4631dfd-c6c6-4958-a5b3-11cdec54b595', 'a38a5b60-76eb-4700-a56d-6e07ce1be614'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 Sep 28 15:09:53 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:53 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:53 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0" returned: 0 in 0.546s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:54 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0 Sep 28 15:09:54 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:54 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321" returned: 0 in 0.334s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8ae03e-9dd2-4278-9ad8-7f528bcc9f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c226a98a-fc94-4192-aa85-50a829eda321', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dea1a71-01bd-4e96-a682-ba7e061b5931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Volume volume-c226a98a-fc94-4192-aa85-50a829eda321 (c226a98a-fc94-4192-aa85-50a829eda321): created successfully Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dea1a71-01bd-4e96-a682-ba7e061b5931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Flow 'volume_create_manager' (e8a0eca3-b092-4f4d-b25c-4a9bc8359fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a52a7171-d2c2-4d32-afa3-63830b4f2d4b tempest-AbsoluteLimitsTests-2113606786 None] Created volume successfully. Sep 28 15:09:54 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.343s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Deleted volume successfully. Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8b74eacc-040d-4d1d-8b25-14ccb3b192e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1119629496 None] Lock "cinder-bca07b31-5dbf-4d1b-8db5-be00d6224fcb-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:54 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2.2261e6ee-f9bd-489c-b9ba-8888c2b001b0" returned: 0 in 0.345s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Acquiring lock "cinder-30764c96-4e00-421c-8f5e-9511e2d33592-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-quobyte-2261e6ee-f9bd-489c-b9ba-8888c2b001b0" released by "_delete_snapshot" :: held 2.067s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-quobyte-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" released by "delete_snapshot" :: held 2.097s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Lock "cinder-30764c96-4e00-421c-8f5e-9511e2d33592-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Acquiring lock "cinder-quobyte-30764c96-4e00-421c-8f5e-9511e2d33592" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Lock "cinder-quobyte-30764c96-4e00-421c-8f5e-9511e2d33592" acquired by "delete_volume" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15cb21c-d5ca-470e-b54f-9856264d8121]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Created reservations ['daaad16d-ee51-473f-b635-e292d2db8077', '0ce2fe14-5b18-42df-94b9-7519d8d252b4', 'e4146832-1035-4774-ae0d-8ab9a3d942db', '8f4de18e-319c-4cfc-a2c0-d7f5e09e03fa'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Delete snapshot completed successfully. Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a990b10-c7e6-46ea-8911-15c8df76e26d tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-2261e6ee-f9bd-489c-b9ba-8888c2b001b0-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:54 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 Sep 28 15:09:54 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Acquiring lock "cinder-c226a98a-fc94-4192-aa85-50a829eda321-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:54 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592" returned: 0 in 0.466s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Lock "cinder-c226a98a-fc94-4192-aa85-50a829eda321-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:55 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592 Sep 28 15:09:55 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Acquiring lock "cinder-quobyte-c226a98a-fc94-4192-aa85-50a829eda321" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Lock "cinder-quobyte-c226a98a-fc94-4192-aa85-50a829eda321" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a176d140-3e4e-47aa-be9d-41130d242642]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:55 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 Sep 28 15:09:55 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:55 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30764c96-4e00-421c-8f5e-9511e2d33592" returned: 0 in 0.330s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Lock "cinder-quobyte-30764c96-4e00-421c-8f5e-9511e2d33592" released by "delete_volume" :: held 0.866s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Created reservations ['4da625a3-1a17-4024-93d7-29bf32ec2181', '840904f0-bfe8-4d31-a111-4e1de20d96d9', 'b2a9e72d-e321-42c0-936b-b64d90100aab', '8efcf260-59dc-4470-8b5a-6288da6d19ee'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:55 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:55 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "cinder-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "cinder-quobyte-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-quobyte-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:55 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321" returned: 0 in 0.701s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca999c7f-acdb-4d29-b17f-c89d915923b6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:55 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321 Sep 28 15:09:55 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:56 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 Sep 28 15:09:56 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:56 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.510s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Deleted volume successfully. Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b918212a-5c43-4b64-912b-5791085d17d7 tempest-VolumesCloneNegativeTest-1084501603 None] Lock "cinder-30764c96-4e00-421c-8f5e-9511e2d33592-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:56 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c226a98a-fc94-4192-aa85-50a829eda321" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Lock "cinder-quobyte-c226a98a-fc94-4192-aa85-50a829eda321" released by "delete_volume" :: held 1.223s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Created reservations ['456e7b35-292d-4986-8166-4a4882e6c06d', '7dde9c62-886e-412a-9a89-4d13dae4d55d', 'd80248c6-cf1c-4557-b2bc-842c4c18e3f8', 'ba3745e8-60b3-409e-9eda-791a82f99785'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:56 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" returned: 0 in 0.598s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:56 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2 Sep 28 15:09:56 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:56 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:56 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:56 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.346s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:56 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" returned: 0 in 0.440s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Deleted volume successfully. Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-quobyte-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2" released by "delete_volume" :: held 1.175s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-97ad9ce4-9b08-4ee7-bbc0-80c5f6879bda tempest-AbsoluteLimitsTests-2113606786 None] Lock "cinder-c226a98a-fc94-4192-aa85-50a829eda321-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Created reservations ['cb0f794b-f076-43b8-b31a-bf2730fafd64', '71bb427b-107b-4546-8b23-d41bfab8e320', 'cf3bfa14-bd1d-4312-a3a5-dec181da4a8e', '410123fd-3d0f-4bfe-8b1a-e7c249ca696f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:57 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:09:57 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:57 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.399s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Deleted volume successfully. Sep 28 15:09:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b9141584-14d3-420b-a40b-ec5001a5e6d7 tempest-VolumesSnapshotNegativeTestJSON-31112041 None] Lock "cinder-b54ba299-cd9f-4bb5-b8e0-5648f669e2a2-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Flow 'volume_create_manager' (2909a22f-6173-4380-9eb0-824c4a256331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e46f28-e534-46da-908a-d4026470bae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e46f28-e534-46da-908a-d4026470bae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-717148200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69232bfa-04e1-4a01-8f95-19409d873669,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2c1531390b84a29bf6d86ebdd69114e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:03Z,use_quota=True,user_id='e95de0f827a54acc87a16803f494fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b70165-8ad6-49c5-90fa-dbaf7784a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b70165-8ad6-49c5-90fa-dbaf7784a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e85ac46-b54e-4857-876f-fcb2b8167cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e85ac46-b54e-4857-876f-fcb2b8167cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69232bfa-04e1-4a01-8f95-19409d873669', 'volume_name': 'volume-69232bfa-04e1-4a01-8f95-19409d873669', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af1071c-4b39-488b-8e01-ed0029251776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af1071c-4b39-488b-8e01-ed0029251776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ac3cfc-37d0-497b-b1e7-ccd182cac269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Volume 69232bfa-04e1-4a01-8f95-19409d873669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69232bfa-04e1-4a01-8f95-19409d873669', 'volume_size': 1} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-717148200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69232bfa-04e1-4a01-8f95-19409d873669,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2c1531390b84a29bf6d86ebdd69114e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:03Z,use_quota=True,user_id='e95de0f827a54acc87a16803f494fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Creating volume 69232bfa-04e1-4a01-8f95-19409d873669 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:02 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 1073741824 Sep 28 15:10:02 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:03 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 1073741824" returned: 0 in 0.581s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:03 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 Sep 28 15:10:03 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:03 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669" returned: 0 in 0.362s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ac3cfc-37d0-497b-b1e7-ccd182cac269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69232bfa-04e1-4a01-8f95-19409d873669', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3604756-98f3-492c-bcab-fd64faafc000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:03 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Volume volume-69232bfa-04e1-4a01-8f95-19409d873669 (69232bfa-04e1-4a01-8f95-19409d873669): created successfully Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3604756-98f3-492c-bcab-fd64faafc000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Flow 'volume_create_manager' (2909a22f-6173-4380-9eb0-824c4a256331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-37239afe-b6e8-4114-b530-6a655d603b26 tempest-VolumesListTestJSON-436944862 None] Created volume successfully. Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Flow 'volume_create_manager' (5642de10-3c87-4101-bda4-c55bd17bbef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59300ec5-a3ff-4d12-a2ee-1b26b7e308fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59300ec5-a3ff-4d12-a2ee-1b26b7e308fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1809744189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca11a7-6c5b-419e-aba0-6568df8b5727,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2c1531390b84a29bf6d86ebdd69114e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:06Z,use_quota=True,user_id='e95de0f827a54acc87a16803f494fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e6975a-87b2-4b8f-a53f-b4340447ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e6975a-87b2-4b8f-a53f-b4340447ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cbf339-4e41-4351-8cac-5ba58f725a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cbf339-4e41-4351-8cac-5ba58f725a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ca11a7-6c5b-419e-aba0-6568df8b5727', 'volume_name': 'volume-60ca11a7-6c5b-419e-aba0-6568df8b5727', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f4a132-4fe8-4bb8-8b6a-39e8ca0c6028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f4a132-4fe8-4bb8-8b6a-39e8ca0c6028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c292ca2c-b93b-4373-b845-93fd67e6ec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:05 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Volume 60ca11a7-6c5b-419e-aba0-6568df8b5727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ca11a7-6c5b-419e-aba0-6568df8b5727', 'volume_size': 1} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1809744189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca11a7-6c5b-419e-aba0-6568df8b5727,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2c1531390b84a29bf6d86ebdd69114e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:06Z,use_quota=True,user_id='e95de0f827a54acc87a16803f494fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Creating volume 60ca11a7-6c5b-419e-aba0-6568df8b5727 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:06 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:06 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 1073741824 Sep 28 15:10:06 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Flow 'volume_create_manager' (88203e44-9dd4-4ac5-9f55-9f508e84ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef63387a-a8b5-47f8-9fe5-9a8b5ff85fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef63387a-a8b5-47f8-9fe5-9a8b5ff85fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-882749505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3437a391-d322-4569-9dd4-a0947c9392d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665618f0c7c74df58fe8ba74f089be9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:07Z,use_quota=True,user_id='08cc01aa5d4546f3a2f6bc65811dd2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5482dd8b-a57f-4e90-bf96-c8ae8739e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5482dd8b-a57f-4e90-bf96-c8ae8739e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a13c7fc-46c2-42c5-aa8f-fa7387ac9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a13c7fc-46c2-42c5-aa8f-fa7387ac9710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3437a391-d322-4569-9dd4-a0947c9392d9', 'volume_name': 'volume-3437a391-d322-4569-9dd4-a0947c9392d9', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ac06f4-2728-4397-b032-eda89ef9eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ac06f4-2728-4397-b032-eda89ef9eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6027cc-1a0a-48b4-98bf-4b4755ef1649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Volume 3437a391-d322-4569-9dd4-a0947c9392d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3437a391-d322-4569-9dd4-a0947c9392d9', 'volume_size': 1} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:06 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 1073741824" returned: 0 in 0.740s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:06 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 Sep 28 15:10:06 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:07 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727" returned: 0 in 0.334s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-882749505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3437a391-d322-4569-9dd4-a0947c9392d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665618f0c7c74df58fe8ba74f089be9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:07Z,use_quota=True,user_id='08cc01aa5d4546f3a2f6bc65811dd2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Creating volume 3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:07 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c292ca2c-b93b-4373-b845-93fd67e6ec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ca11a7-6c5b-419e-aba0-6568df8b5727', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec5b7db-feb9-45b8-98e4-377efb50ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:07 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 1073741824 Sep 28 15:10:07 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Volume volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 (60ca11a7-6c5b-419e-aba0-6568df8b5727): created successfully Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec5b7db-feb9-45b8-98e4-377efb50ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Flow 'volume_create_manager' (5642de10-3c87-4101-bda4-c55bd17bbef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-424ae5e6-6b11-4bba-a24d-1b6e7909cf00 tempest-VolumesListTestJSON-436944862 None] Created volume successfully. Sep 28 15:10:07 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 1073741824" returned: 0 in 0.771s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:08 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 Sep 28 15:10:08 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:08 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9" returned: 0 in 0.401s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6027cc-1a0a-48b4-98bf-4b4755ef1649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3437a391-d322-4569-9dd4-a0947c9392d9', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f4922-c1b1-4178-8e16-babc403fc606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Volume volume-3437a391-d322-4569-9dd4-a0947c9392d9 (3437a391-d322-4569-9dd4-a0947c9392d9): created successfully Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f4922-c1b1-4178-8e16-babc403fc606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Flow 'volume_create_manager' (88203e44-9dd4-4ac5-9f55-9f508e84ef73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:08 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-62e5d1bd-a27b-40ba-a4f0-0c79c92151f3 tempest-VolumesCloneTest-729591044 None] Created volume successfully. Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Flow 'volume_create_manager' (d1c5eb5d-9498-4ad2-a715-462ecda4d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d063caca-4f4c-40e3-9120-c967fb2825ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d063caca-4f4c-40e3-9120-c967fb2825ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-640719631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d303a19-6702-4345-a61f-836ef7277708,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2c1531390b84a29bf6d86ebdd69114e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:09Z,use_quota=True,user_id='e95de0f827a54acc87a16803f494fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e55de8-f8a6-4af5-9b5d-b6c713a32e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e55de8-f8a6-4af5-9b5d-b6c713a32e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ba9806-77c7-45fc-985e-3cae2d6227d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ba9806-77c7-45fc-985e-3cae2d6227d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d303a19-6702-4345-a61f-836ef7277708', 'volume_name': 'volume-5d303a19-6702-4345-a61f-836ef7277708', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b19fb4-2353-4beb-86cc-49a9583dfb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b19fb4-2353-4beb-86cc-49a9583dfb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ebdb78-53e9-4386-bb8e-bfbcd9b66696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Volume 5d303a19-6702-4345-a61f-836ef7277708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d303a19-6702-4345-a61f-836ef7277708', 'volume_size': 1} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-640719631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d303a19-6702-4345-a61f-836ef7277708,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2c1531390b84a29bf6d86ebdd69114e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:09Z,use_quota=True,user_id='e95de0f827a54acc87a16803f494fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Creating volume 5d303a19-6702-4345-a61f-836ef7277708 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:08 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:08 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 1073741824 Sep 28 15:10:08 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:09 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 1073741824" returned: 0 in 0.621s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:09 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 Sep 28 15:10:09 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Flow 'volume_create_manager' (54be4c9c-6479-4bf6-8005-fecded2a4b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0bffbd-7faa-43cc-80f9-9aa8d9e72792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:09 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708" returned: 0 in 0.523s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0bffbd-7faa-43cc-80f9-9aa8d9e72792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2137417255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665618f0c7c74df58fe8ba74f089be9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3437a391-d322-4569-9dd4-a0947c9392d9,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:10Z,use_quota=True,user_id='08cc01aa5d4546f3a2f6bc65811dd2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170f9131-b89a-4d86-b9c5-653b9cf64bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170f9131-b89a-4d86-b9c5-653b9cf64bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d2c2c3-ea81-4a14-989a-a168d00f403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d2c2c3-ea81-4a14-989a-a168d00f403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9', 'volume_name': 'volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9', 'volume_size': 2, 'source_volid': '3437a391-d322-4569-9dd4-a0947c9392d9', 'source_volstatus': 'available'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87dbd45-9795-4a82-9cf3-a942e3937364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87dbd45-9795-4a82-9cf3-a942e3937364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2698d81-4ed7-4db9-bd3b-19a26461428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Volume 6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9', 'volume_size': 2, 'source_volid': '3437a391-d322-4569-9dd4-a0947c9392d9', 'source_volstatus': 'available'} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ebdb78-53e9-4386-bb8e-bfbcd9b66696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d303a19-6702-4345-a61f-836ef7277708', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a916518f-8051-4028-9adb-d16bd04bb287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:10 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Cloning volume 3437a391-d322-4569-9dd4-a0947c9392d9 to volume 6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 Sep 28 15:10:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Volume volume-5d303a19-6702-4345-a61f-836ef7277708 (5d303a19-6702-4345-a61f-836ef7277708): created successfully Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a916518f-8051-4028-9adb-d16bd04bb287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Flow 'volume_create_manager' (d1c5eb5d-9498-4ad2-a715-462ecda4d509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a252cccc-f91a-4603-a584-f7bf0358b7f1 tempest-VolumesListTestJSON-436944862 None] Created volume successfully. Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Creating offline snapshot 9a90716c-1f43-402b-983e-1605db87ed7e of volume 3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a44e8c-950e-4be4-986a-3220365041f3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:10 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 Sep 28 15:10:10 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:10 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9" returned: 0 in 0.569s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:10 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e 1G Sep 28 15:10:10 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:11 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e 1G" returned: 0 in 0.717s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3437a391-d322-4569-9dd4-a0947c9392d9 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:11 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3437a391-d322-4569-9dd4-a0947c9392d9 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e Sep 28 15:10:11 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3437a391-d322-4569-9dd4-a0947c9392d9 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e" returned: 0 in 0.590s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e is being set with open permissions: ugo+rw Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e Sep 28 15:10:12 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e" returned: 0 in 0.477s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=113,cinder:UPDATE=135,cinder:INSERT=44,cinder:DELETE=9 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=116,cinder:UPDATE=138,cinder:INSERT=33,cinder:DELETE=15 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info Sep 28 15:10:12 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info" returned: 0 in 0.427s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info is being set with open permissions: ugo+rw Sep 28 15:10:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info Sep 28 15:10:13 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:13 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.info" returned: 0 in 0.478s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Acquiring lock "cinder-quobyte-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] snapshot: 9a90716c-1f43-402b-983e-1605db87ed7e, volume: 6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb57ed9a-2a13-4bbb-a9ca-4d512f57e7d9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e Sep 28 15:10:13 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Acquiring lock "cinder-5d303a19-6702-4345-a61f-836ef7277708-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:14 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e" returned: 0 in 0.714s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3437a391-d322-4569-9dd4-a0947c9392d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Lock "cinder-5d303a19-6702-4345-a61f-836ef7277708-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8e190-6040-44a3-9574-c9e3abda8ee3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Acquiring lock "cinder-quobyte-5d303a19-6702-4345-a61f-836ef7277708" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Lock "cinder-quobyte-5d303a19-6702-4345-a61f-836ef7277708" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:14 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 Sep 28 15:10:14 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0596266-7eb0-4095-a4af-25b1c98b37aa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:14 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 Sep 28 15:10:14 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:14 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9" returned: 0 in 0.553s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:10:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:14 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 Sep 28 15:10:14 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:15 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708" returned: 0 in 0.490s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:15 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708 Sep 28 15:10:15 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:15 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d303a19-6702-4345-a61f-836ef7277708" returned: 0 in 0.592s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Lock "cinder-quobyte-5d303a19-6702-4345-a61f-836ef7277708" released by "delete_volume" :: held 1.166s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Created reservations ['83ce2782-131c-477b-88d4-8b391d140db6', '066398e9-6dd8-4fdc-8021-51d9630f8231', 'd4ea069a-99a3-4130-a83e-e3e99c00f89d', '4a086635-53a2-485b-a8d4-1b8bad63c9d1'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:16 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:16 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:16 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.644s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:16 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Deleted volume successfully. Sep 28 15:10:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cc8eef35-e726-43c1-8f0d-b818ff16b93a tempest-VolumesListTestJSON-436944862 None] Lock "cinder-5d303a19-6702-4345-a61f-836ef7277708-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Acquiring lock "cinder-60ca11a7-6c5b-419e-aba0-6568df8b5727-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Lock "cinder-60ca11a7-6c5b-419e-aba0-6568df8b5727-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Acquiring lock "cinder-quobyte-60ca11a7-6c5b-419e-aba0-6568df8b5727" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Lock "cinder-quobyte-60ca11a7-6c5b-419e-aba0-6568df8b5727" acquired by "delete_volume" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c42471-86ce-4187-81db-9d6b832218de]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 Sep 28 15:10:17 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727" returned: 0 in 0.923s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:18 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727 Sep 28 15:10:18 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-60ca11a7-6c5b-419e-aba0-6568df8b5727" returned: 0 in 0.866s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Lock "cinder-quobyte-60ca11a7-6c5b-419e-aba0-6568df8b5727" released by "delete_volume" :: held 1.923s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Created reservations ['87b937a7-4a76-4f8b-8e81-55a1d56a911c', '2d6cc8ba-79f0-4efd-8460-c1333475402d', '7c5192c6-0a5c-4a56-a956-b46a9fa183e3', '167be483-c362-4b22-a9a5-0348b4999981'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:19 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "cinder-69232bfa-04e1-4a01-8f95-19409d873669-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Lock "cinder-69232bfa-04e1-4a01-8f95-19409d873669-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:19 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.521s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:19 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Deleted volume successfully. Sep 28 15:10:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "cinder-quobyte-69232bfa-04e1-4a01-8f95-19409d873669" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-068d3f40-e9bc-4344-a69a-d5be6efa65ce tempest-VolumesListTestJSON-436944862 None] Lock "cinder-60ca11a7-6c5b-419e-aba0-6568df8b5727-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Lock "cinder-quobyte-69232bfa-04e1-4a01-8f95-19409d873669" acquired by "delete_volume" :: waited 0.063s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7554e55e-2c9f-4617-b7c3-8872da54e378]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 Sep 28 15:10:20 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669" returned: 0 in 1.242s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669 Sep 28 15:10:21 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-69232bfa-04e1-4a01-8f95-19409d873669" returned: 0 in 0.491s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Lock "cinder-quobyte-69232bfa-04e1-4a01-8f95-19409d873669" released by "delete_volume" :: held 1.881s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Created reservations ['d0b0ec63-97ae-4ef5-8c89-23f481418b76', '4d4e87a8-d03d-4b30-b652-fc7e26ae1807', 'a144f548-c5b7-4b8e-af38-5c5f85b8bc1c', 'f6fc1b5b-015c-4d29-ac14-6002518f99e9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:22 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:22 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:22 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.543s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:22 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Deleted volume successfully. Sep 28 15:10:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-270f3168-c7b0-4295-8e7a-3685d79abe83 tempest-VolumesListTestJSON-436944862 None] Lock "cinder-69232bfa-04e1-4a01-8f95-19409d873669-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:25 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" returned: 0 in 10.831s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:25 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9, size 1024.00 MB, duration 10.83 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:25 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Converted 1024.00 MB image at 94.54 MB/s Sep 28 15:10:25 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 is being set with open permissions: ugo+rw Sep 28 15:10:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:25 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 Sep 28 15:10:25 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:26 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" released by "_copy_volume_from_snapshot" :: held 12.665s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Acquiring lock "cinder-quobyte-9a90716c-1f43-402b-983e-1605db87ed7e" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-9a90716c-1f43-402b-983e-1605db87ed7e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Deleting offline snapshot 9a90716c-1f43-402b-983e-1605db87ed7e of volume 3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] snapshot_file for this snap is: volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9693c-bebb-436d-b6de-ce82217fe9ef]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:26 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e Sep 28 15:10:26 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:26 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e" returned: 0 in 0.508s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3437a391-d322-4569-9dd4-a0947c9392d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e6b39-6dbe-4118-a615-63a4e475b20d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:27 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 Sep 28 15:10:27 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:27 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9" returned: 0 in 0.843s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:27 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e Sep 28 15:10:27 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:28 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e" returned: 0 in 0.536s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:28 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e Sep 28 15:10:28 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:28 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9.9a90716c-1f43-402b-983e-1605db87ed7e" returned: 0 in 0.454s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-9a90716c-1f43-402b-983e-1605db87ed7e" released by "_delete_snapshot" :: held 2.539s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.860s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2698d81-4ed7-4db9-bd3b-19a26461428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9', 'volume_size': 2, 'source_volid': '3437a391-d322-4569-9dd4-a0947c9392d9', 'source_volstatus': 'available'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0aa3fec-b897-47b6-9b05-8184708f99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:28 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Volume volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 (6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9): created successfully Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0aa3fec-b897-47b6-9b05-8184708f99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Flow 'volume_create_manager' (54be4c9c-6479-4bf6-8005-fecded2a4b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e98f844f-3074-44f5-8101-70c2c0619c91 tempest-VolumesCloneTest-729591044 None] Created volume successfully. Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Flow 'volume_create_manager' (886f4b44-33d4-4440-975f-a8e5205fc0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c35a8c-f539-457f-b079-2b9d7463fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c35a8c-f539-457f-b079-2b9d7463fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1336572969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6759d127-d5d7-47fe-935d-9612c8d9a132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0235ccbfe6d04ba9b383e3b75a6441c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:30Z,use_quota=True,user_id='24eb19b285d74fc9b7332781a7056191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8d95d4-2d23-4caa-bc86-f7bc5bdf6b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8d95d4-2d23-4caa-bc86-f7bc5bdf6b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dd6a8e-a33c-4ec0-8252-92b853d91011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dd6a8e-a33c-4ec0-8252-92b853d91011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6759d127-d5d7-47fe-935d-9612c8d9a132', 'volume_name': 'volume-6759d127-d5d7-47fe-935d-9612c8d9a132', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f08c125-2494-4b67-95d1-515af336a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f08c125-2494-4b67-95d1-515af336a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b255589-f8b5-4177-9896-3370c01a63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:29 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Volume 6759d127-d5d7-47fe-935d-9612c8d9a132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6759d127-d5d7-47fe-935d-9612c8d9a132', 'volume_size': 1} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1336572969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6759d127-d5d7-47fe-935d-9612c8d9a132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0235ccbfe6d04ba9b383e3b75a6441c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:30Z,use_quota=True,user_id='24eb19b285d74fc9b7332781a7056191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Creating volume 6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:29 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:29 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 1073741824 Sep 28 15:10:29 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Acquiring lock "cinder-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Lock "cinder-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Acquiring lock "cinder-quobyte-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e7b447-d9a6-4120-b376-bda65100be7a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:30 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 Sep 28 15:10:30 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:30 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 1073741824" returned: 0 in 0.814s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:30 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 Sep 28 15:10:30 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:30 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" returned: 0 in 0.616s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:30 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9 Sep 28 15:10:30 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132" returned: 0 in 0.462s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b255589-f8b5-4177-9896-3370c01a63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6759d127-d5d7-47fe-935d-9612c8d9a132', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e562e5c-d1c3-4a60-a004-1b4dccf463ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:31 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Volume volume-6759d127-d5d7-47fe-935d-9612c8d9a132 (6759d127-d5d7-47fe-935d-9612c8d9a132): created successfully Sep 28 15:10:31 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e562e5c-d1c3-4a60-a004-1b4dccf463ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Flow 'volume_create_manager' (886f4b44-33d4-4440-975f-a8e5205fc0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" returned: 0 in 0.523s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a8a66089-415d-4cfd-b202-549a603f5130 tempest-VolumesDeleteCascade-578547004 None] Created volume successfully. Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9" released by "delete_volume" :: held 1.244s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Created reservations ['cee3c4c9-ab1c-494f-903f-17940ba43928', 'e73212f5-e9bb-4124-8d27-6d504dfc05cc', 'e31e09f2-10fd-4067-b605-258067aa8353', 'b9f5638a-efcd-496a-8440-aa73000aced9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:31 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:31 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Deleted volume successfully. Sep 28 15:10:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e4af7e71-d2f8-462a-92d9-6ee23277f755 tempest-VolumesCloneTest-729591044 None] Lock "cinder-6bfa30e9-3bdd-4410-8ecf-73dc0a7c9be9-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Creating offline snapshot dbafaf9b-4824-4cb1-8394-a27420554a27 of volume 6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b15422-59e6-447e-a6d6-5bf6bbd20aa1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 Sep 28 15:10:32 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Acquiring lock "cinder-3437a391-d322-4569-9dd4-a0947c9392d9-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Lock "cinder-3437a391-d322-4569-9dd4-a0947c9392d9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Acquiring lock "cinder-quobyte-3437a391-d322-4569-9dd4-a0947c9392d9" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-3437a391-d322-4569-9dd4-a0947c9392d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff86cd79-1ae9-4812-bb31-4edb9131fbe0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132" returned: 0 in 0.689s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 1G Sep 28 15:10:32 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 Sep 28 15:10:32 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9" returned: 0 in 0.781s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9 Sep 28 15:10:33 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 1G" returned: 0 in 0.691s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6759d127-d5d7-47fe-935d-9612c8d9a132 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6759d127-d5d7-47fe-935d-9612c8d9a132 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:33 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3437a391-d322-4569-9dd4-a0947c9392d9" returned: 0 in 0.467s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Lock "cinder-quobyte-3437a391-d322-4569-9dd4-a0947c9392d9" released by "delete_volume" :: held 1.388s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6759d127-d5d7-47fe-935d-9612c8d9a132 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.425s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 is being set with open permissions: ugo+rw Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:34 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Created reservations ['68569ebb-55fd-462e-afc1-8791078c09db', '7e225cf4-b87b-46bf-886e-8fe9f744391d', 'c8ae5e64-e442-4228-b977-79329183220c', 'e953a6e8-a910-4aab-90b8-f010c3db9934'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:34 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.469s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info Sep 28 15:10:34 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.398s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Deleted volume successfully. Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4a4c2491-bf42-4025-8a1a-4b64ed27d1a9 tempest-VolumesCloneTest-729591044 None] Lock "cinder-3437a391-d322-4569-9dd4-a0947c9392d9-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:34 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info" returned: 0 in 0.396s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info is being set with open permissions: ugo+rw Sep 28 15:10:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info Sep 28 15:10:35 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.info" returned: 0 in 0.406s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.256s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-aafe27fe-97c2-4b1b-9ad3-85e3f23ed091 tempest-VolumesDeleteCascade-578547004 None] Create snapshot completed successfully Sep 28 15:10:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Creating offline snapshot d020b97d-0f1e-44bd-8787-afb55288be49 of volume 6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:36 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af8a20-be73-4e30-a21a-add8a17033cc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:37 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:37 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.653s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6759d127-d5d7-47fe-935d-9612c8d9a132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 1G Sep 28 15:10:37 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:10:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:10:38 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 1G" returned: 0 in 0.782s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 Sep 28 15:10:38 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49" returned: 0 in 0.452s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 is being set with open permissions: ugo+rw Sep 28 15:10:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 Sep 28 15:10:38 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49" returned: 0 in 0.374s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:39 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-635d39c8-a0ca-4aad-b049-733e303f8553 tempest-VolumesDeleteCascade-578547004 None] Create snapshot completed successfully Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-6759d127-d5d7-47fe-935d-9612c8d9a132-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-6759d127-d5d7-47fe-935d-9612c8d9a132-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Performing cascade delete. {{(pid=87124) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-d020b97d-0f1e-44bd-8787-afb55288be49-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-d020b97d-0f1e-44bd-8787-afb55288be49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-d020b97d-0f1e-44bd-8787-afb55288be49" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-d020b97d-0f1e-44bd-8787-afb55288be49" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Deleting offline snapshot d020b97d-0f1e-44bd-8787-afb55288be49 of volume 6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] snapshot_file for this snap is: volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0a5e09-089e-45bf-9bd7-8c8184455d5e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 Sep 28 15:10:40 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49" returned: 0 in 0.556s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6759d127-d5d7-47fe-935d-9612c8d9a132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb7012-957a-4973-8a42-4f5e34ab43f8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:41 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:41 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:41 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.533s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6759d127-d5d7-47fe-935d-9612c8d9a132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:41 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 Sep 28 15:10:41 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49" returned: 0 in 0.700s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:42 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49 Sep 28 15:10:42 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.d020b97d-0f1e-44bd-8787-afb55288be49" returned: 0 in 0.522s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-d020b97d-0f1e-44bd-8787-afb55288be49" released by "_delete_snapshot" :: held 2.487s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" released by "delete_snapshot" :: held 2.521s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Created reservations ['95eba94e-5712-4fe0-aac0-bd83e38d4a6c', '74214951-84ba-41d1-9ddd-547551fbc078', 'a89575be-c701-41dc-bb96-a73180cb3213', '21253908-d5b7-4615-b37b-5cb4a67ac85c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Delete snapshot completed successfully. Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-d020b97d-0f1e-44bd-8787-afb55288be49-delete_snapshot" released by "delete_snapshot" :: held 2.780s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-dbafaf9b-4824-4cb1-8394-a27420554a27-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-dbafaf9b-4824-4cb1-8394-a27420554a27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-dbafaf9b-4824-4cb1-8394-a27420554a27" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-dbafaf9b-4824-4cb1-8394-a27420554a27" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Deleting offline snapshot dbafaf9b-4824-4cb1-8394-a27420554a27 of volume 6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] snapshot_file for this snap is: volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ac24a4-62b1-4827-b0d8-bbb5e404f204]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:43 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:43 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:43 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.839s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6759d127-d5d7-47fe-935d-9612c8d9a132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a006839-5f8f-4b03-94ef-a183fe2f758f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 Sep 28 15:10:44 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132" returned: 0 in 0.634s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:44 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:45 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.623s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:45 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27 Sep 28 15:10:45 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:45 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132.dbafaf9b-4824-4cb1-8394-a27420554a27" returned: 0 in 0.368s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:45 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-dbafaf9b-4824-4cb1-8394-a27420554a27" released by "_delete_snapshot" :: held 2.680s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:45 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" released by "delete_snapshot" :: held 2.734s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:45 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Created reservations ['fc393499-0bd3-4b86-bf30-d2d4908c4917', '68612318-e82d-49e0-b138-405cac1097cd', '6da7acc2-e6e2-4915-a6ee-428eb64cf45b', '1c6663bd-959e-4455-a676-24dec7df70e0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Delete snapshot completed successfully. Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-dbafaf9b-4824-4cb1-8394-a27420554a27-delete_snapshot" released by "delete_snapshot" :: held 3.002s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Snapshots deleted, issuing volume delete {{(pid=87124) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226d0d6-ab6f-4958-b6d1-2e1123bc2970]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 Sep 28 15:10:46 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:46 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132" returned: 0 in 0.723s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132 Sep 28 15:10:46 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Flow 'volume_create_manager' (858242d0-b0e6-4585-aa0b-2656496a3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:47 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa17bf5-7000-4a1f-8537-72911490c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6759d127-d5d7-47fe-935d-9612c8d9a132" returned: 0 in 0.392s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa17bf5-7000-4a1f-8537-72911490c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2002779670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d6f07e-f4e5-4fab-a16d-be115275fe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc498cfbe36427c83a650d6559ff95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:47Z,use_quota=True,user_id='5c074a74682c4e7ca33cf1147df06e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4bc670-eda2-45fb-a7d8-3ce73c1673d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4bc670-eda2-45fb-a7d8-3ce73c1673d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b10b66-1e3f-47ec-a0a5-fea19485dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-6759d127-d5d7-47fe-935d-9612c8d9a132" released by "delete_volume" :: held 1.294s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Created reservations ['7970fbf8-d81a-4906-bfad-98f20094dc29', 'e4199a18-af0a-49c1-a1b7-b412f0fb0cc6', 'dcc54401-0a00-4ae3-819a-468a3deee13f', '2ef0b8af-f284-4a6c-8893-ca7fbb3d22ac'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:10:47 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b10b66-1e3f-47ec-a0a5-fea19485dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41d6f07e-f4e5-4fab-a16d-be115275fe31', 'volume_name': 'volume-41d6f07e-f4e5-4fab-a16d-be115275fe31', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc55808-3ffc-406a-81f7-0d9151409e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc55808-3ffc-406a-81f7-0d9151409e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3983fbf-ffca-4b4e-8f17-4002168f5400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Volume 41d6f07e-f4e5-4fab-a16d-be115275fe31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41d6f07e-f4e5-4fab-a16d-be115275fe31', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:10:47 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Trying to clone 41d6f07e-f4e5-4fab-a16d-be115275fe31 from image c58ceb91-c951-49e6-a030-d9ed772c37aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:10:48 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.520s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Deleted volume successfully. Sep 28 15:10:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a583c106-9cbf-4c53-bbdf-f223796a9b2b tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-6759d127-d5d7-47fe-935d-9612c8d9a132-delete_volume" released by "delete_volume" :: held 8.181s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:48 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:10:48 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:10:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0052ee91-9454-48cc-90ee-88f33a79f529]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:48 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD Sep 28 15:10:48 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD" returned: 0 in 0.621s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa is fetched for user 5c074a74682c4e7ca33cf1147df06e9a. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f5ae79-afce-47ed-8159-c0e9be6617e5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD Sep 28 15:10:49 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Flow 'volume_create_manager' (2bfa0e2d-dcaa-4c68-8f87-4e5160972019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b843c9-3b8d-498b-bf08-e242237cb41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b843c9-3b8d-498b-bf08-e242237cb41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1814065737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262c804b-bfd7-4527-b76e-55aec44e2ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0235ccbfe6d04ba9b383e3b75a6441c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:50Z,use_quota=True,user_id='24eb19b285d74fc9b7332781a7056191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af16e0f-2a4d-4970-a084-361f053dddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af16e0f-2a4d-4970-a084-361f053dddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a16c1d-f84b-44c4-a7a6-cc41bf7f8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a16c1d-f84b-44c4-a7a6-cc41bf7f8727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262c804b-bfd7-4527-b76e-55aec44e2ba2', 'volume_name': 'volume-262c804b-bfd7-4527-b76e-55aec44e2ba2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22d95a0-e1a7-42c5-b4f3-41cbae3ef224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22d95a0-e1a7-42c5-b4f3-41cbae3ef224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a87d68-d730-415f-a5a6-546464d9d986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Volume 262c804b-bfd7-4527-b76e-55aec44e2ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262c804b-bfd7-4527-b76e-55aec44e2ba2', 'volume_size': 1} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1814065737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262c804b-bfd7-4527-b76e-55aec44e2ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0235ccbfe6d04ba9b383e3b75a6441c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:50Z,use_quota=True,user_id='24eb19b285d74fc9b7332781a7056191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Creating volume 262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 1073741824 Sep 28 15:10:49 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:50 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD" returned: 0 in 0.603s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:50 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 1073741824" returned: 0 in 0.783s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:50 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 Sep 28 15:10:50 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:51 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2" returned: 0 in 0.377s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.145s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2002779670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d6f07e-f4e5-4fab-a16d-be115275fe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc498cfbe36427c83a650d6559ff95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:47Z,use_quota=True,user_id='5c074a74682c4e7ca33cf1147df06e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Creating volume 41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:51 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a87d68-d730-415f-a5a6-546464d9d986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262c804b-bfd7-4527-b76e-55aec44e2ba2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:51 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 1073741824 Sep 28 15:10:51 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e68f6a-6001-487b-b03e-dad3c1ac7b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:51 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Volume volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 (262c804b-bfd7-4527-b76e-55aec44e2ba2): created successfully Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e68f6a-6001-487b-b03e-dad3c1ac7b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Flow 'volume_create_manager' (2bfa0e2d-dcaa-4c68-8f87-4e5160972019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d96b9da8-3da6-449a-91ea-c503665ecdf6 tempest-VolumesDeleteCascade-578547004 None] Created volume successfully. Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:52 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 1073741824" returned: 0 in 0.944s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 Sep 28 15:10:52 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:52 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (fdb95747-cbe9-4cf1-9455-61abef9a0bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d1cff6-bdb2-4a30-84ce-d5b8d5097bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31" returned: 0 in 0.412s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.603s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d1cff6-bdb2-4a30-84ce-d5b8d5097bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-142203441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83325042-e830-406a-b087-59b9a545647d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:53Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bd119e-4737-42df-a9eb-b37d2a0941a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bd119e-4737-42df-a9eb-b37d2a0941a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d7741e-dae8-43fd-b5d9-eaa1866d34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d7741e-dae8-43fd-b5d9-eaa1866d34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83325042-e830-406a-b087-59b9a545647d', 'volume_name': 'volume-83325042-e830-406a-b087-59b9a545647d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec6ef49-4264-4a5e-a5f6-a55a8cea84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec6ef49-4264-4a5e-a5f6-a55a8cea84fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ad7661-1a35-4f17-afc8-c8e028afb0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Volume 83325042-e830-406a-b087-59b9a545647d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83325042-e830-406a-b087-59b9a545647d', 'volume_size': 1} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Creating offline snapshot 61f60831-5fdc-40c9-811e-679b5512feab of volume 262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Attempting download of c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 41d6f07e-f4e5-4fab-a16d-be115275fe31. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdecb73-a09f-437d-b38f-25d9cfc5ab74]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ae38d-ab80-4f4a-bbec-4010839ea790]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 Sep 28 15:10:52 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr Sep 28 15:10:53 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2" returned: 0 in 0.505s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:53 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab 1G Sep 28 15:10:53 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr" returned: 0 in 0.527s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:53 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr Sep 28 15:10:53 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr" returned: 1 in 0.559s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_4hevu5pr' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37979b-fbe0-4e37-afcc-5083c96f03d5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:54 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD Sep 28 15:10:54 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:54 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab 1G" returned: 0 in 0.933s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:54 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab Sep 28 15:10:54 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:54 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] c58ceb91-c951-49e6-a030-d9ed772c37aa was qcow2, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:54 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 Sep 28 15:10:54 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:54 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab" returned: 0 in 0.461s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:54 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab is being set with open permissions: ugo+rw Sep 28 15:10:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:54 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab Sep 28 15:10:54 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:55 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab" returned: 0 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:55 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info Sep 28 15:10:55 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:55 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info" returned: 0 in 0.396s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:55 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info is being set with open permissions: ugo+rw Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:55 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info Sep 28 15:10:55 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:55 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.info" returned: 0 in 0.373s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.234s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.180s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-142203441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83325042-e830-406a-b087-59b9a545647d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:53Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Creating volume 83325042-e830-406a-b087-59b9a545647d {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:55 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:10:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:55 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d 1073741824 Sep 28 15:10:55 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-32381ba7-3aeb-4f21-b831-2e7013d06e0f tempest-VolumesDeleteCascade-578547004 None] Create snapshot completed successfully Sep 28 15:10:56 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d 1073741824" returned: 0 in 0.721s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:56 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d Sep 28 15:10:56 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:57 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d" returned: 0 in 0.458s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ad7661-1a35-4f17-afc8-c8e028afb0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83325042-e830-406a-b087-59b9a545647d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149b4bbc-a9bf-46d0-b217-3558ba33a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:57 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Volume volume-83325042-e830-406a-b087-59b9a545647d (83325042-e830-406a-b087-59b9a545647d): created successfully Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149b4bbc-a9bf-46d0-b217-3558ba33a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (fdb95747-cbe9-4cf1-9455-61abef9a0bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-398dfb2c-47d2-4313-83a4-09dea31fc8cf tempest-VolumesSnapshotTestJSON-483827991 None] Created volume successfully. Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Flow 'volume_create_manager' (618c4b59-d9da-4cf1-bfe2-0e8bf887a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7797b13e-bf88-4d65-81e4-fbcd9dd84854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7797b13e-bf88-4d65-81e4-fbcd9dd84854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1075595476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0235ccbfe6d04ba9b383e3b75a6441c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61f60831-5fdc-40c9-811e-679b5512feab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:57Z,use_quota=True,user_id='24eb19b285d74fc9b7332781a7056191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360f13c7-cf66-454a-9e4b-e74b57226b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:57 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360f13c7-cf66-454a-9e4b-e74b57226b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1729ccfe-e213-411f-9915-55800fc00237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1729ccfe-e213-411f-9915-55800fc00237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09', 'volume_name': 'volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09', 'volume_size': 1, 'snapshot_id': '61f60831-5fdc-40c9-811e-679b5512feab'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12338dab-a7a4-4e36-b06f-4160bbada31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12338dab-a7a4-4e36-b06f-4160bbada31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44adcbef-fc81-4f9e-8242-178d53b53cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:57 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Volume f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09', 'volume_size': 1, 'snapshot_id': '61f60831-5fdc-40c9-811e-679b5512feab'} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31" returned: 0 in 3.117s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa__sodnq40devstack@QuobyteHD, size 112.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:57 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Converted 112.00 MB image at 35.79 MB/s Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:57 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 1G Sep 28 15:10:57 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-61f60831-5fdc-40c9-811e-679b5512feab-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-61f60831-5fdc-40c9-811e-679b5512feab-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Creating volume f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 from snapshot 61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] snapshot: 61f60831-5fdc-40c9-811e-679b5512feab, volume: f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5c8d3d-ca31-4320-a332-140ac5daf7dd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:58 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab Sep 28 15:10:58 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:58 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 1G" returned: 0 in 0.971s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Downloaded image c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 41d6f07e-f4e5-4fab-a16d-be115275fe31 successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa for user 5c074a74682c4e7ca33cf1147df06e9a is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Marking volume 41d6f07e-f4e5-4fab-a16d-be115275fe31 as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Copying metadata from image c58ceb91-c951-49e6-a030-d9ed772c37aa to 41d6f07e-f4e5-4fab-a16d-be115275fe31. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Creating volume glance metadata for volume 41d6f07e-f4e5-4fab-a16d-be115275fe31 backed by image c58ceb91-c951-49e6-a030-d9ed772c37aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:10:58 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab" returned: 0 in 0.768s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-262c804b-bfd7-4527-b76e-55aec44e2ba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4872e165-5445-4661-9bb7-9b53bd1fa8cd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3983fbf-ffca-4b4e-8f17-4002168f5400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d6f07e-f4e5-4fab-a16d-be115275fe31', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfffdfd-1719-4ad4-8f4d-9826c48df473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:58 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Volume volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 (41d6f07e-f4e5-4fab-a16d-be115275fe31): created successfully Sep 28 15:10:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfffdfd-1719-4ad4-8f4d-9826c48df473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Flow 'volume_create_manager' (858242d0-b0e6-4585-aa0b-2656496a3d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:59 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5af1b4f2-4cfb-4f75-b25e-d5e05e61aec3 tempest-VolumesExtendTest-908779217 None] Created volume successfully. Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:59 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 Sep 28 15:10:59 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:59 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2" returned: 0 in 0.807s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:59 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 Sep 28 15:10:59 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Flow 'volume_create_manager' (4027d7d0-8c6a-4ada-8452-9ae461834e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ca50c1-4fcb-4d11-a246-99f8a8eeb498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ca50c1-4fcb-4d11-a246-99f8a8eeb498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1363857433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4883ba93-1259-468b-b708-92efe0903b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9698c934243148d28e953b37e410bff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:07Z,use_quota=True,user_id='1ad33ad1a3ce410baf44d021b0a21658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e95cb4b-4f51-45dc-b35b-d1931727a322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e95cb4b-4f51-45dc-b35b-d1931727a322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2f5a1d-e50d-44dd-9576-89f78fa9bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2f5a1d-e50d-44dd-9576-89f78fa9bf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4883ba93-1259-468b-b708-92efe0903b1a', 'volume_name': 'volume-4883ba93-1259-468b-b708-92efe0903b1a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe686f71-ceb9-4c95-984e-8d228c57d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe686f71-ceb9-4c95-984e-8d228c57d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d21874-828e-4807-a9fb-db9cc2c568c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Volume 4883ba93-1259-468b-b708-92efe0903b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4883ba93-1259-468b-b708-92efe0903b1a', 'volume_size': 1} Sep 28 15:11:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:09 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" returned: 0 in 9.556s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2, size 1024.00 MB, duration 9.56 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:11:09 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Converted 1024.00 MB image at 107.14 MB/s Sep 28 15:11:09 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 is being set with open permissions: ugo+rw Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 Sep 28 15:11:09 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:09 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" released by "_copy_volume_from_snapshot" :: held 11.629s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-61f60831-5fdc-40c9-811e-679b5512feab-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" released by "_create_volume_from_snapshot" :: held 11.732s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.776s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.355s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Creating offline snapshot 5b4b7387-683a-4ef7-88ff-fec546c83449 of volume 83325042-e830-406a-b087-59b9a545647d {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44adcbef-fc81-4f9e-8242-178d53b53cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09', 'volume_size': 1, 'snapshot_id': '61f60831-5fdc-40c9-811e-679b5512feab'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a02f6d-f943-4b23-a399-7c2b7f2a8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff896cc9-8b8b-43f6-adf2-b6a2fb66bd30]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Volume volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 (f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09): created successfully Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a02f6d-f943-4b23-a399-7c2b7f2a8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Flow 'volume_create_manager' (618c4b59-d9da-4cf1-bfe2-0e8bf887a745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0fb4355d-3b4c-4764-823b-2848c9ebdb94 tempest-VolumesDeleteCascade-578547004 None] Created volume successfully. Sep 28 15:11:09 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d Sep 28 15:11:09 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:09 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d" returned: 0 in 0.463s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 1G Sep 28 15:11:09 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-262c804b-bfd7-4527-b76e-55aec44e2ba2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-262c804b-bfd7-4527-b76e-55aec44e2ba2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Performing cascade delete. {{(pid=87124) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-61f60831-5fdc-40c9-811e-679b5512feab-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-61f60831-5fdc-40c9-811e-679b5512feab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-262c804b-bfd7-4527-b76e-55aec44e2ba2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-262c804b-bfd7-4527-b76e-55aec44e2ba2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-61f60831-5fdc-40c9-811e-679b5512feab" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-61f60831-5fdc-40c9-811e-679b5512feab" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Deleting offline snapshot 61f60831-5fdc-40c9-811e-679b5512feab of volume 262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] snapshot_file for this snap is: volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[913c5855-de6b-4d0d-89dc-2c4084297ff7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:10 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 1G" returned: 0 in 0.634s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83325042-e830-406a-b087-59b9a545647d -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:10 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83325042-e830-406a-b087-59b9a545647d -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 Sep 28 15:11:10 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab Sep 28 15:11:10 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab" returned: 0 in 0.478s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-262c804b-bfd7-4527-b76e-55aec44e2ba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:11 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83325042-e830-406a-b087-59b9a545647d -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449" returned: 0 in 0.479s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 is being set with open permissions: ugo+rw Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c821c785-4c9d-4ed3-9eef-076a2d84d1ba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 Sep 28 15:11:11 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 Sep 28 15:11:11 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info Sep 28 15:11:11 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2" returned: 0 in 0.666s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab Sep 28 15:11:11 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info" returned: 0 in 0.320s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info is being set with open permissions: ugo+rw Sep 28 15:11:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info Sep 28 15:11:11 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:12 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.info" returned: 0 in 0.316s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.358s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:12 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab" returned: 0 in 0.410s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12c6e3-7abf-4c0b-b510-ec422f2e1c6b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab Sep 28 15:11:12 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bbef2410-0b76-4cd2-9f41-a43ceb7ab7e1 tempest-VolumesSnapshotTestJSON-483827991 None] Create snapshot completed successfully Sep 28 15:11:12 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 Sep 28 15:11:12 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:12 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2.61f60831-5fdc-40c9-811e-679b5512feab" returned: 0 in 0.324s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-61f60831-5fdc-40c9-811e-679b5512feab" released by "_delete_snapshot" :: held 2.029s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-262c804b-bfd7-4527-b76e-55aec44e2ba2" released by "delete_snapshot" :: held 2.071s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=92,cinder:DELETE=6 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=84,cinder:INSERT=35,cinder:UPDATE=79,cinder:DELETE=10 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Created reservations ['4b798648-74a0-4b6b-bfd5-c4e1690539e5', 'c1e67804-daaf-4fd9-bdb0-6f01a6811866', '586ef598-195a-4af2-a8e1-98bbebe7268b', '94b94d5e-4466-4d2c-8c2f-669df287dcd1'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Delete snapshot completed successfully. Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-61f60831-5fdc-40c9-811e-679b5512feab-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Snapshots deleted, issuing volume delete {{(pid=87124) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-262c804b-bfd7-4527-b76e-55aec44e2ba2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-262c804b-bfd7-4527-b76e-55aec44e2ba2" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:12 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31" returned: 0 in 0.616s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 2G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2664e-ffba-4eef-9a6e-0d850f4bd71c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 2G" returned: 0 in 0.124s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.783s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.858s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1363857433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4883ba93-1259-468b-b708-92efe0903b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9698c934243148d28e953b37e410bff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:07Z,use_quota=True,user_id='1ad33ad1a3ce410baf44d021b0a21658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Creating volume 4883ba93-1259-468b-b708-92efe0903b1a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:12 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:11:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 Sep 28 15:11:12 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:12 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a 1073741824 Sep 28 15:11:12 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c036c5d2-300d-46b7-84ee-eece7e138a41 tempest-VolumesExtendTest-908779217 None] Extend volume completed successfully. Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-5b4b7387-683a-4ef7-88ff-fec546c83449-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:13 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-5b4b7387-683a-4ef7-88ff-fec546c83449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2" returned: 0 in 0.659s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:13 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2 Sep 28 15:11:13 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-83325042-e830-406a-b087-59b9a545647d" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-83325042-e830-406a-b087-59b9a545647d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-5b4b7387-683a-4ef7-88ff-fec546c83449" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-5b4b7387-683a-4ef7-88ff-fec546c83449" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Deleting offline snapshot 5b4b7387-683a-4ef7-88ff-fec546c83449 of volume 83325042-e830-406a-b087-59b9a545647d {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] snapshot_file for this snap is: volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3ab96a-502e-4fe1-ae1b-ccb1181a722f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:13 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a 1073741824" returned: 0 in 0.731s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:13 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a Sep 28 15:11:13 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 Sep 28 15:11:13 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:14 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-262c804b-bfd7-4527-b76e-55aec44e2ba2" returned: 0 in 0.528s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-262c804b-bfd7-4527-b76e-55aec44e2ba2" released by "delete_volume" :: held 1.293s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Created reservations ['9a5297d5-1260-4dfc-a9ad-42cb627d9519', '605c9986-d9f1-438f-ac40-adce8c8785e6', '1b6e3212-a625-4f88-b3ba-54c71b9afa8c', '9dbbfe0a-2f28-4759-b00b-6d4a7072f74b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:14 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a" returned: 0 in 0.524s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d21874-828e-4807-a9fb-db9cc2c568c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4883ba93-1259-468b-b708-92efe0903b1a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0b2cef-d2c1-4cc5-bdf7-0b17033f67a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Volume volume-4883ba93-1259-468b-b708-92efe0903b1a (4883ba93-1259-468b-b708-92efe0903b1a): created successfully Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0b2cef-d2c1-4cc5-bdf7-0b17033f67a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Flow 'volume_create_manager' (4027d7d0-8c6a-4ada-8452-9ae461834e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-012e7969-2ad9-4fb4-8edb-d6407db24d40 tempest-TestMinimumBasicScenario-2019900524 None] Created volume successfully. Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:14 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:14 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-41d6f07e-f4e5-4fab-a16d-be115275fe31-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Lock "cinder-41d6f07e-f4e5-4fab-a16d-be115275fe31-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:14 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-quobyte-41d6f07e-f4e5-4fab-a16d-be115275fe31" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449" returned: 0 in 1.118s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83325042-e830-406a-b087-59b9a545647d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-41d6f07e-f4e5-4fab-a16d-be115275fe31" acquired by "delete_volume" :: waited 0.068s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393c077-9d3a-4a56-9fac-91d524fa2cf5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbad78-abe8-4227-a732-b56e94fc04c3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:15 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.535s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Deleted volume successfully. Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9630c699-e6b7-474c-bf44-33d659a4739c tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-262c804b-bfd7-4527-b76e-55aec44e2ba2-delete_volume" released by "delete_volume" :: held 4.796s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:15 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d Sep 28 15:11:15 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:15 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 Sep 28 15:11:15 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "cinder-quobyte-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" acquired by "delete_volume" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb94ae-c61c-4baa-b4a8-9296dac7dfc5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:15 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 Sep 28 15:11:15 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:15 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d" returned: 0 in 1.014s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:15 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31" returned: 0 in 1.027s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:15 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 Sep 28 15:11:15 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:15 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31 Sep 28 15:11:15 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:16 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-41d6f07e-f4e5-4fab-a16d-be115275fe31" returned: 0 in 0.468s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-41d6f07e-f4e5-4fab-a16d-be115275fe31" released by "delete_volume" :: held 1.583s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:16 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" returned: 0 in 0.944s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:16 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09 Sep 28 15:11:16 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:16 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449" returned: 0 in 0.685s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:16 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449 Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Created reservations ['18e5f8e9-fbe5-4e9d-8c7c-70c88a16940a', '376e6ab3-6388-441d-b09b-a3b7bdef158f', 'a506cde5-f257-49db-bf3f-8931b6c1bab2', '00e4acca-95cb-42df-9779-816e96048b32'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:16 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:16 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:16 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:17 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" returned: 0 in 0.535s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-quobyte-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09" released by "delete_volume" :: held 1.584s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d.5b4b7387-683a-4ef7-88ff-fec546c83449" returned: 0 in 0.475s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-5b4b7387-683a-4ef7-88ff-fec546c83449" released by "_delete_snapshot" :: held 3.535s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-83325042-e830-406a-b087-59b9a545647d" released by "delete_snapshot" :: held 3.575s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-016d07f6-ebe0-41a2-aeef-583578217f58 req-f94f6832-d2c2-4d26-89dd-83188100d208 tempest-TestMinimumBasicScenario-2019900524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-016d07f6-ebe0-41a2-aeef-583578217f58 req-f94f6832-d2c2-4d26-89dd-83188100d208 tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Created reservations ['c3abcb2b-c32f-4afb-9ede-fb3f98e26adb', '553366cd-92fc-4986-844c-c4686597f292', 'f60d11c4-7265-419a-9ea4-d90dee0d5db8', '7e1416cb-d79f-43f8-9b71-a5d4e5291bed'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-016d07f6-ebe0-41a2-aeef-583578217f58 req-f94f6832-d2c2-4d26-89dd-83188100d208 tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:17 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.394s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Deleted volume successfully. Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-016d07f6-ebe0-41a2-aeef-583578217f58 req-f94f6832-d2c2-4d26-89dd-83188100d208 tempest-TestMinimumBasicScenario-2019900524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-4883ba93-1259-468b-b708-92efe0903b1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a588d31-2817-4b00-b923-b47c38fa59e7', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a196b16c-54be-418d-9698-3a6bc482a850 tempest-VolumesExtendTest-908779217 None] Lock "cinder-41d6f07e-f4e5-4fab-a16d-be115275fe31-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:17 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:17 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['71b6a19a-27c9-4d7c-8302-5d55c26aeac5', 'b932ec45-f3bd-43c1-96ac-628fb027a2e0', 'b819e653-ead7-4c85-acb3-542f8ef6b132', '3982dc55-14c7-4d5b-850b-a444fed1967c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-016d07f6-ebe0-41a2-aeef-583578217f58 req-f94f6832-d2c2-4d26-89dd-83188100d208 tempest-TestMinimumBasicScenario-2019900524 None] attachment_update completed successfully. Sep 28 15:11:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Delete snapshot completed successfully. Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-403baa13-a654-42a1-9b8b-5463e685b660 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-5b4b7387-683a-4ef7-88ff-fec546c83449-delete_snapshot" released by "delete_snapshot" :: held 4.160s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.460s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Deleted volume successfully. Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-723577d9-be7f-4cee-b85c-5fe3792212be tempest-VolumesDeleteCascade-578547004 None] Lock "cinder-f3fdf1f4-aa85-4ba5-93b2-6d3993f62d09-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Flow 'volume_create_manager' (0178b2d6-3c74-4575-b268-0f913111edcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2808e2-f601-488e-afa3-b929c6ea38d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2808e2-f601-488e-afa3-b929c6ea38d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1431681785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54db5f64-49f3-48df-94f8-4f4de236a18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc498cfbe36427c83a650d6559ff95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:18Z,use_quota=True,user_id='5c074a74682c4e7ca33cf1147df06e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a41a1d-28b7-4c88-b031-8b12fbcf8714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a41a1d-28b7-4c88-b031-8b12fbcf8714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81658a3b-af02-46ab-b012-a177c7d54705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81658a3b-af02-46ab-b012-a177c7d54705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54db5f64-49f3-48df-94f8-4f4de236a18c', 'volume_name': 'volume-54db5f64-49f3-48df-94f8-4f4de236a18c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb400e6-38b8-499d-817d-2cfe81d542f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb400e6-38b8-499d-817d-2cfe81d542f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd866d5-b0db-433f-98af-b0f24627e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Volume 54db5f64-49f3-48df-94f8-4f4de236a18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54db5f64-49f3-48df-94f8-4f4de236a18c', 'volume_size': 1} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1431681785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54db5f64-49f3-48df-94f8-4f4de236a18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc498cfbe36427c83a650d6559ff95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:18Z,use_quota=True,user_id='5c074a74682c4e7ca33cf1147df06e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Creating volume 54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:18 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:18 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c 1073741824 Sep 28 15:11:18 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (62895b69-897b-4744-bef7-ca19c8a6a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775b0026-6266-425c-b90f-c678a9b73e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775b0026-6266-425c-b90f-c678a9b73e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1774448675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0346836-b6dd-4d94-bb17-c73464520349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:19Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085fd30c-0afd-4b54-99b7-bb67986e6508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085fd30c-0afd-4b54-99b7-bb67986e6508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e628baec-7fdc-426b-bc59-6988ac32ee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e628baec-7fdc-426b-bc59-6988ac32ee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0346836-b6dd-4d94-bb17-c73464520349', 'volume_name': 'volume-c0346836-b6dd-4d94-bb17-c73464520349', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba623ce-866b-497c-83c6-ee14e3f50053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba623ce-866b-497c-83c6-ee14e3f50053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ee4ad1-9717-4258-8cac-0b3095f9851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Volume c0346836-b6dd-4d94-bb17-c73464520349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0346836-b6dd-4d94-bb17-c73464520349', 'volume_size': 1} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c 1073741824" returned: 0 in 0.818s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:19 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c Sep 28 15:11:19 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:19 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c" returned: 0 in 0.320s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1774448675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0346836-b6dd-4d94-bb17-c73464520349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:19Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Creating volume c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:19 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd866d5-b0db-433f-98af-b0f24627e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54db5f64-49f3-48df-94f8-4f4de236a18c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff48cff-c7d2-4b52-a8df-01adca6579fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:19 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 1073741824 Sep 28 15:11:19 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:19 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Volume volume-54db5f64-49f3-48df-94f8-4f4de236a18c (54db5f64-49f3-48df-94f8-4f4de236a18c): created successfully Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff48cff-c7d2-4b52-a8df-01adca6579fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Flow 'volume_create_manager' (0178b2d6-3c74-4575-b268-0f913111edcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ebbf09ba-1de0-4731-8550-d7d112b52356 tempest-VolumesExtendTest-908779217 None] Created volume successfully. Sep 28 15:11:19 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 1073741824" returned: 0 in 0.556s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:19 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 Sep 28 15:11:19 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349" returned: 0 in 0.323s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ee4ad1-9717-4258-8cac-0b3095f9851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0346836-b6dd-4d94-bb17-c73464520349', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5eb7597-ce12-4f35-870b-68e79cc7a25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Volume volume-c0346836-b6dd-4d94-bb17-c73464520349 (c0346836-b6dd-4d94-bb17-c73464520349): created successfully Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5eb7597-ce12-4f35-870b-68e79cc7a25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (62895b69-897b-4744-bef7-ca19c8a6a813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a0bcdb28-833f-4a65-9763-1cfde2055afa tempest-VolumesSnapshotTestJSON-483827991 None] Created volume successfully. Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Creating offline snapshot 4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 of volume 54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ac3aa-d32c-4ec8-9fe7-49c12cf0d843]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c Sep 28 15:11:20 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c" returned: 0 in 0.642s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 1G Sep 28 15:11:21 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:21 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 1G" returned: 0 in 0.564s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54db5f64-49f3-48df-94f8-4f4de236a18c -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54db5f64-49f3-48df-94f8-4f4de236a18c -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 Sep 28 15:11:21 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54db5f64-49f3-48df-94f8-4f4de236a18c -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" returned: 0 in 0.365s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 is being set with open permissions: ugo+rw Sep 28 15:11:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 Sep 28 15:11:22 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" returned: 0 in 0.286s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info Sep 28 15:11:22 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info" returned: 0 in 0.333s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info is being set with open permissions: ugo+rw Sep 28 15:11:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info Sep 28 15:11:22 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.info" returned: 0 in 0.294s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.881s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Creating offline snapshot b421a1d5-b693-4375-8434-fb3dc300209b of volume c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:11:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d5a0c7cc-d292-4461-933a-1139d870a928 tempest-VolumesExtendTest-908779217 None] Create snapshot completed successfully Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77fc477-19a5-4015-a3fa-70c4a70197fe]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 Sep 28 15:11:23 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349" returned: 0 in 0.636s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b 1G Sep 28 15:11:23 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:24 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b 1G" returned: 0 in 0.734s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0346836-b6dd-4d94-bb17-c73464520349 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0346836-b6dd-4d94-bb17-c73464520349 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b Sep 28 15:11:24 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0346836-b6dd-4d94-bb17-c73464520349 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b" returned: 0 in 0.701s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b is being set with open permissions: ugo+rw Sep 28 15:11:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b Sep 28 15:11:25 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b" returned: 0 in 0.493s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info Sep 28 15:11:25 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info" returned: 0 in 0.341s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info is being set with open permissions: ugo+rw Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info Sep 28 15:11:26 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.info" returned: 0 in 0.538s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.678s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.914s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b5617-164d-4ddd-914b-663e477f6769]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0734ca10-66f2-4b71-851e-c4b8195de745 tempest-VolumesSnapshotTestJSON-483827991 None] Create snapshot completed successfully Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Flow 'volume_create_manager' (d5978615-be2f-4719-a2a6-98af7572c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cf667d-b22a-45a8-b404-c36339e76e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cf667d-b22a-45a8-b404-c36339e76e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1212519860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad2a5c314ac4c83a89a2780027ac1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:27Z,use_quota=True,user_id='6fc5d2e1eedc412baf16f55276893d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6016a82b-882e-4a2b-801d-d7e63c01f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6016a82b-882e-4a2b-801d-d7e63c01f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbfb490-9e2f-4ff7-87a0-56784146ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:27 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c Sep 28 15:11:27 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbfb490-9e2f-4ff7-87a0-56784146ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e', 'volume_name': 'volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0319c-8047-4c39-9dc7-1b5827e9e23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0319c-8047-4c39-9dc7-1b5827e9e23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba2d96-c5cf-43f5-b313-3ffef820b810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:27 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Volume fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e', 'volume_size': 1} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:27 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c" returned: 0 in 0.680s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 2G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 2G" returned: 0 in 0.203s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.973s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1212519860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad2a5c314ac4c83a89a2780027ac1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:27Z,use_quota=True,user_id='6fc5d2e1eedc412baf16f55276893d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Creating volume fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:27 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:11:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e 1073741824 Sep 28 15:11:27 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2a6b2e0c-83af-4641-86ae-215f13a36629 tempest-VolumesExtendTest-908779217 None] Extend volume completed successfully. Sep 28 15:11:28 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e 1073741824" returned: 0 in 0.670s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:28 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e Sep 28 15:11:28 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (56e39d83-8859-4b70-a584-447b3cb4ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109bb44e-efa0-4c0c-81e6-35b800f86aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109bb44e-efa0-4c0c-81e6-35b800f86aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-503438525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e5e3eb-e28a-4f51-aebc-2c3e68badeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b421a1d5-b693-4375-8434-fb3dc300209b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:28Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1980057-785e-49e7-a2c1-ebaf55a8f3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1980057-785e-49e7-a2c1-ebaf55a8f3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6589a30a-717c-43ef-8157-b5fe80190bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6589a30a-717c-43ef-8157-b5fe80190bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7e5e3eb-e28a-4f51-aebc-2c3e68badeae', 'volume_name': 'volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae', 'volume_size': 2, 'snapshot_id': 'b421a1d5-b693-4375-8434-fb3dc300209b'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc82c69-6e19-44d2-84c0-53726251e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc82c69-6e19-44d2-84c0-53726251e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd432847-a668-43f4-921a-3fa33b2fca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Volume c7e5e3eb-e28a-4f51-aebc-2c3e68badeae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae', 'volume_size': 2, 'snapshot_id': 'b421a1d5-b693-4375-8434-fb3dc300209b'} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-4c99bfde-5b0d-4cf3-b34d-7e6e161b2246-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Lock "cinder-4c99bfde-5b0d-4cf3-b34d-7e6e161b2246-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-quobyte-54db5f64-49f3-48df-94f8-4f4de236a18c" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-54db5f64-49f3-48df-94f8-4f4de236a18c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-quobyte-4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Deleting offline snapshot 4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 of volume 54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] snapshot_file for this snap is: volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb706e7-c0f3-4483-9759-98b7a1017dfe]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e" returned: 0 in 0.383s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.214s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-b421a1d5-b693-4375-8434-fb3dc300209b-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba2d96-c5cf-43f5-b313-3ffef820b810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4545c840-39c9-4a0e-9bf5-1f30c4ebc4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-b421a1d5-b693-4375-8434-fb3dc300209b-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Creating volume c7e5e3eb-e28a-4f51-aebc-2c3e68badeae from snapshot b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:28 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:28 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Volume volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e (fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e): created successfully Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4545c840-39c9-4a0e-9bf5-1f30c4ebc4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Flow 'volume_create_manager' (d5978615-be2f-4719-a2a6-98af7572c5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] snapshot: b421a1d5-b693-4375-8434-fb3dc300209b, volume: c7e5e3eb-e28a-4f51-aebc-2c3e68badeae, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:11:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8db0a240-731d-4eec-ac1a-02731d99fba4 tempest-VolumesTransfersV355Test-211056672 None] Created volume successfully. Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e05cf-83e8-4af8-a8ae-57ef312b2975]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:29 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b Sep 28 15:11:29 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:29 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" returned: 0 in 0.626s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54db5f64-49f3-48df-94f8-4f4de236a18c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a9ded-bdf5-4c88-b721-ad6375c6bbc9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:29 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c Sep 28 15:11:29 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:29 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b" returned: 0 in 0.582s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0346836-b6dd-4d94-bb17-c73464520349(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[9920f04d-ed4d-4063-9240-f0d1d6d393f5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:29 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 Sep 28 15:11:29 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:30 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c" returned: 0 in 0.623s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:30 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 Sep 28 15:11:30 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:30 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349" returned: 0 in 0.630s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:30 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae Sep 28 15:11:30 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:30 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" returned: 0 in 0.890s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:31 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246 Sep 28 15:11:31 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7542ceb3-ebde-4b4e-91b0-2adfa89c9b90 tempest-VolumesTransfersV355Test-506953206 None] Transfer volume completed successfully. Sep 28 15:11:31 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c.4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" returned: 0 in 0.776s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-4c99bfde-5b0d-4cf3-b34d-7e6e161b2246" released by "_delete_snapshot" :: held 3.151s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-54db5f64-49f3-48df-94f8-4f4de236a18c" released by "delete_snapshot" :: held 3.179s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:32 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Created reservations ['758b515f-3c51-4022-a430-39b9f374fde3', '02b98e90-dbef-4284-a0c6-8653f259a170', 'eb25c34f-a0c1-4a43-b610-03d6577110ff', '9fb9abcb-1c41-46bf-9889-e676a5f2d207'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Delete snapshot completed successfully. Sep 28 15:11:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb4b1fa2-266d-44de-9185-2581f22d6661 tempest-VolumesExtendTest-908779217 None] Lock "cinder-4c99bfde-5b0d-4cf3-b34d-7e6e161b2246-delete_snapshot" released by "delete_snapshot" :: held 3.540s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-54db5f64-49f3-48df-94f8-4f4de236a18c-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Lock "cinder-54db5f64-49f3-48df-94f8-4f4de236a18c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Acquiring lock "cinder-quobyte-54db5f64-49f3-48df-94f8-4f4de236a18c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-54db5f64-49f3-48df-94f8-4f4de236a18c" acquired by "delete_volume" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Acquiring lock "cinder-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87fd3d-1b8e-44bf-9a7d-6b6795abffe6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Acquiring lock "cinder-quobyte-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-quobyte-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e" acquired by "delete_volume" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef75f0e2-2f94-4366-bc4b-9febfde2e9b0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c Sep 28 15:11:34 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e Sep 28 15:11:34 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c" returned: 0 in 1.046s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c Sep 28 15:11:34 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:35 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e" returned: 0 in 1.023s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:35 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e Sep 28 15:11:35 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:35 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54db5f64-49f3-48df-94f8-4f4de236a18c" returned: 0 in 0.522s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Lock "cinder-quobyte-54db5f64-49f3-48df-94f8-4f4de236a18c" released by "delete_volume" :: held 1.800s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Created reservations ['e52e5404-dca5-447a-8dcc-acf5861efe48', '02b62de0-4587-4f6d-8c74-6dbfb335b2e4', '9ca46f4a-3967-477c-95b9-29cbbf3e7e45', '421c36c3-92fa-420e-8e5f-e1aa27c4d9c4'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:35 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e" returned: 0 in 0.738s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-quobyte-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e" released by "delete_volume" :: held 1.923s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:35 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Created reservations ['e0f66389-b152-43e8-8809-b957a4da34c8', '9f8c664a-bcab-4024-8696-e5aee353be9d', '4ac5e752-9b6c-4aee-b413-e2ce0c98c37a', '9b4f5222-7f08-46b6-9eb0-7cf8a2efde1f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:36 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:36 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:36 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.890s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Deleted volume successfully. Sep 28 15:11:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-634b53a4-5dd1-4d4b-ad65-c40a20973c49 tempest-VolumesExtendTest-908779217 None] Lock "cinder-54db5f64-49f3-48df-94f8-4f4de236a18c-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:37 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.801s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Deleted volume successfully. Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f156ddb0-7c4a-4441-af2c-e0bca2f090ab tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-fae1ed8f-0ae7-4ce2-9ee9-3e2fecf75c8e-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:37 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:37 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.548s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:11:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:11:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Flow 'volume_create_manager' (3d77e095-e59a-482a-a4e8-70789a96036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f68506-79d0-40d1-8fa9-6a6cf834231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f68506-79d0-40d1-8fa9-6a6cf834231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1654876494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929c7f69-c09e-48be-bb58-d1e1087c2940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad2a5c314ac4c83a89a2780027ac1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:39Z,use_quota=True,user_id='6fc5d2e1eedc412baf16f55276893d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4395ba20-39cc-482d-9b8e-1f72e0ef9a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4395ba20-39cc-482d-9b8e-1f72e0ef9a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce79f00-108f-4073-a750-9639c83a26b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce79f00-108f-4073-a750-9639c83a26b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929c7f69-c09e-48be-bb58-d1e1087c2940', 'volume_name': 'volume-929c7f69-c09e-48be-bb58-d1e1087c2940', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bd8d2e-8076-4402-a931-0625a2d15cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bd8d2e-8076-4402-a931-0625a2d15cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e62e0c7-58ce-4e20-9559-6ffbcf869600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:39 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Volume 929c7f69-c09e-48be-bb58-d1e1087c2940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929c7f69-c09e-48be-bb58-d1e1087c2940', 'volume_size': 1} Sep 28 15:11:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:40 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" returned: 0 in 10.192s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:11:40 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Converted 1024.00 MB image at 100.46 MB/s Sep 28 15:11:40 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae is being set with open permissions: ugo+rw Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:40 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae Sep 28 15:11:40 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:40 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" returned: 0 in 0.289s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" released by "_copy_volume_from_snapshot" :: held 11.887s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-b421a1d5-b693-4375-8434-fb3dc300209b-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" released by "_create_volume_from_snapshot" :: held 11.988s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.052s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1654876494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929c7f69-c09e-48be-bb58-d1e1087c2940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad2a5c314ac4c83a89a2780027ac1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:39Z,use_quota=True,user_id='6fc5d2e1eedc412baf16f55276893d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Creating volume 929c7f69-c09e-48be-bb58-d1e1087c2940 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:40 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:11:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:40 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 1073741824 Sep 28 15:11:40 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd432847-a668-43f4-921a-3fa33b2fca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae', 'volume_size': 2, 'snapshot_id': 'b421a1d5-b693-4375-8434-fb3dc300209b'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68245d7-d1f2-4e74-82b3-e8527459eb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Volume volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae (c7e5e3eb-e28a-4f51-aebc-2c3e68badeae): created successfully Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68245d7-d1f2-4e74-82b3-e8527459eb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (56e39d83-8859-4b70-a584-447b3cb4ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:41 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-07e20920-0ae4-4e9d-8660-e79c9fa7c551 tempest-VolumesSnapshotTestJSON-483827991 None] Created volume successfully. Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f3d6b-38d3-4066-b8c0-8dc5b8baa640]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:41 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 1073741824" returned: 0 in 0.692s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:41 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae Sep 28 15:11:41 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:41 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 Sep 28 15:11:41 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e62e0c7-58ce-4e20-9559-6ffbcf869600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929c7f69-c09e-48be-bb58-d1e1087c2940', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05879cf0-bf1f-4948-9908-fba6611f3da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:42 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" returned: 0 in 0.588s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Volume volume-929c7f69-c09e-48be-bb58-d1e1087c2940 (929c7f69-c09e-48be-bb58-d1e1087c2940): created successfully Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05879cf0-bf1f-4948-9908-fba6611f3da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Flow 'volume_create_manager' (3d77e095-e59a-482a-a4e8-70789a96036b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:42 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae Sep 28 15:11:42 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7cba597f-b19f-4342-94c0-7216b3f9e316 tempest-VolumesTransfersV355Test-211056672 None] Created volume successfully. Sep 28 15:11:42 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" returned: 0 in 0.305s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae" released by "delete_volume" :: held 0.963s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['7877408f-a90a-429e-bc58-bbbeebf1aeb5', '57353842-c96d-4a62-a629-4f9b51391ef6', '9df1cad2-b487-464d-a7d8-288507dea908', '59fcd040-0b8f-485a-84bb-406442d89296'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:42 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.325s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Deleted volume successfully. Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6c4e75f3-c1b0-462d-aa35-45d3192e984d tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-c7e5e3eb-e28a-4f51-aebc-2c3e68badeae-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Acquiring lock "cinder-929c7f69-c09e-48be-bb58-d1e1087c2940-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-929c7f69-c09e-48be-bb58-d1e1087c2940-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Acquiring lock "cinder-quobyte-929c7f69-c09e-48be-bb58-d1e1087c2940" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-quobyte-929c7f69-c09e-48be-bb58-d1e1087c2940" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b548b2a-ebc8-486f-b3cd-3da10592c3e2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-b421a1d5-b693-4375-8434-fb3dc300209b-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-b421a1d5-b693-4375-8434-fb3dc300209b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-c0346836-b6dd-4d94-bb17-c73464520349" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c0346836-b6dd-4d94-bb17-c73464520349" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-b421a1d5-b693-4375-8434-fb3dc300209b" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:43 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 Sep 28 15:11:43 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-b421a1d5-b693-4375-8434-fb3dc300209b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Deleting offline snapshot b421a1d5-b693-4375-8434-fb3dc300209b of volume c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] snapshot_file for this snap is: volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[07118b3d-ca52-4eb7-a8e9-96f672eaac80]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:44 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b Sep 28 15:11:44 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:44 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940" returned: 0 in 0.825s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:44 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940 Sep 28 15:11:44 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:44 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b" returned: 0 in 0.790s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0346836-b6dd-4d94-bb17-c73464520349(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[27335d50-3f40-45ed-b2f4-3d7e5b511b53]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:45 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 Sep 28 15:11:45 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:45 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-929c7f69-c09e-48be-bb58-d1e1087c2940" returned: 0 in 0.548s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-quobyte-929c7f69-c09e-48be-bb58-d1e1087c2940" released by "delete_volume" :: held 1.464s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Created reservations ['62924cf4-7376-4748-a763-bf01d4baba6e', 'b1d9f169-1ed4-44a9-b5cf-e090eaf74fc3', 'a987c8db-023f-43d7-b111-aff739f7dbf3', 'e6ac1a7e-dc2c-4f65-aadb-475cca36f195'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:45 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:45 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:45 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349" returned: 0 in 0.904s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:45 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.312s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:45 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b Sep 28 15:11:45 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Deleted volume successfully. Sep 28 15:11:45 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8c6e7d7b-5b93-4a0c-8fd4-87bffb02c196 tempest-VolumesTransfersV355Test-1027034878 None] Lock "cinder-929c7f69-c09e-48be-bb58-d1e1087c2940-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:46 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b" returned: 0 in 0.653s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:46 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b Sep 28 15:11:46 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:46 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349.b421a1d5-b693-4375-8434-fb3dc300209b" returned: 0 in 0.435s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-b421a1d5-b693-4375-8434-fb3dc300209b" released by "_delete_snapshot" :: held 3.015s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c0346836-b6dd-4d94-bb17-c73464520349" released by "delete_snapshot" :: held 3.043s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:47 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['69baa453-f284-4e22-8f11-c407173c91d7', '165b923d-a255-4abc-a7c2-6c2354bdec0f', '40fe3aec-8b70-462e-a6e2-9f578d43fb99', '50048f4b-12f9-410e-a3b0-f43f50793e68'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Delete snapshot completed successfully. Sep 28 15:11:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ec828bad-e118-451a-981a-096933e4a90a tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-b421a1d5-b693-4375-8434-fb3dc300209b-delete_snapshot" released by "delete_snapshot" :: held 3.663s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-c0346836-b6dd-4d94-bb17-c73464520349-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-c0346836-b6dd-4d94-bb17-c73464520349-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-c0346836-b6dd-4d94-bb17-c73464520349" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c0346836-b6dd-4d94-bb17-c73464520349" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1103c839-affa-42f2-b216-0fb17c5bc22d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:48 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 Sep 28 15:11:48 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:49 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349" returned: 0 in 0.572s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:49 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349 Sep 28 15:11:49 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:49 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c0346836-b6dd-4d94-bb17-c73464520349" returned: 0 in 0.383s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-c0346836-b6dd-4d94-bb17-c73464520349" released by "delete_volume" :: held 1.078s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['fc92d448-a5c9-4442-a1f8-24d7a5aa9fcc', '7140bac5-1527-42b2-a05d-f5278767d01a', '17ce5db3-9e03-4ee1-88f8-91f654469d2b', 'dff43fb8-6075-423d-ae05-6e2f20a8a558'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:50 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:11:50 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:50 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.389s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:50 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Deleted volume successfully. Sep 28 15:11:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5e21f8a2-bfa9-400d-ab88-dd2cd99b911f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-c0346836-b6dd-4d94-bb17-c73464520349-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (671a2639-7b32-4781-9640-d5df24682326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4663615-fa4a-460f-b337-7736e3f0f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4663615-fa4a-460f-b337-7736e3f0f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1114264412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ddce1c-3496-4857-937e-af04ca744311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:52Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d06dd7-0ccb-42cc-bbaf-61b1a7757162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d06dd7-0ccb-42cc-bbaf-61b1a7757162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b58aac-ed42-44a5-9f19-449328606938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b58aac-ed42-44a5-9f19-449328606938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ddce1c-3496-4857-937e-af04ca744311', 'volume_name': 'volume-73ddce1c-3496-4857-937e-af04ca744311', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53563f12-9fcf-4e80-a517-c0c15d52866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53563f12-9fcf-4e80-a517-c0c15d52866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ae205b-77f5-424c-b230-aab11156c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Volume 73ddce1c-3496-4857-937e-af04ca744311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ddce1c-3496-4857-937e-af04ca744311', 'volume_size': 1} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1114264412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ddce1c-3496-4857-937e-af04ca744311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:52Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Creating volume 73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:52 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:52 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 1073741824 Sep 28 15:11:52 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:52 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 1073741824" returned: 0 in 0.764s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:53 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 Sep 28 15:11:53 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:53 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311" returned: 0 in 0.316s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ae205b-77f5-424c-b230-aab11156c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ddce1c-3496-4857-937e-af04ca744311', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ae099a-5ee0-46fd-b6bf-4a665b04b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Volume volume-73ddce1c-3496-4857-937e-af04ca744311 (73ddce1c-3496-4857-937e-af04ca744311): created successfully Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ae099a-5ee0-46fd-b6bf-4a665b04b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (671a2639-7b32-4781-9640-d5df24682326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5df11969-66d7-4e7a-9c48-dec6cb54dcb4 tempest-VolumesSnapshotTestJSON-483827991 None] Created volume successfully. Sep 28 15:11:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Creating offline snapshot eef491ec-1424-4022-8771-f2c1a152a365 of volume 73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:11:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[20109615-3cea-4f0d-83fa-4d49e025ce2e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:54 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 Sep 28 15:11:54 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:55 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311" returned: 0 in 0.698s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:55 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 1G Sep 28 15:11:55 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:55 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 1G" returned: 0 in 0.763s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ddce1c-3496-4857-937e-af04ca744311 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:55 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ddce1c-3496-4857-937e-af04ca744311 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 Sep 28 15:11:55 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:56 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ddce1c-3496-4857-937e-af04ca744311 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:56 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 is being set with open permissions: ugo+rw Sep 28 15:11:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:56 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 Sep 28 15:11:56 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:56 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365" returned: 0 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:56 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info Sep 28 15:11:56 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:57 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info" returned: 0 in 0.354s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:57 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info is being set with open permissions: ugo+rw Sep 28 15:11:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:57 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info Sep 28 15:11:57 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:57 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.info" returned: 0 in 0.310s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.213s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-04950055-818d-4b52-b1df-3bf623264d89 tempest-VolumesSnapshotTestJSON-483827991 None] Create snapshot completed successfully Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (2e006c88-6b31-4ad2-975a-9767c4e3740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf3a4cf-ba27-4b47-b85c-205a7a55c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf3a4cf-ba27-4b47-b85c-205a7a55c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-125047343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6957c3-fd42-44ca-a25c-33a757a9e234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e26303089347c787ebacaa632fb9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eef491ec-1424-4022-8771-f2c1a152a365,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:00Z,use_quota=True,user_id='c2063317b9d34de99d716eb4e2a6eea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c897fa32-e94c-43b9-8329-b4c317ddea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c897fa32-e94c-43b9-8329-b4c317ddea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2972e156-b837-4b1a-80ea-0835844a3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2972e156-b837-4b1a-80ea-0835844a3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be6957c3-fd42-44ca-a25c-33a757a9e234', 'volume_name': 'volume-be6957c3-fd42-44ca-a25c-33a757a9e234', 'volume_size': 1, 'snapshot_id': 'eef491ec-1424-4022-8771-f2c1a152a365'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248158fc-61ae-4ee1-8f56-8d03dccd1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248158fc-61ae-4ee1-8f56-8d03dccd1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf88ec8-8ef9-4bc3-938a-59fd38f27164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:59 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Volume be6957c3-fd42-44ca-a25c-33a757a9e234: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be6957c3-fd42-44ca-a25c-33a757a9e234', 'volume_size': 1, 'snapshot_id': 'eef491ec-1424-4022-8771-f2c1a152a365'} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-eef491ec-1424-4022-8771-f2c1a152a365-be6957c3-fd42-44ca-a25c-33a757a9e234" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-eef491ec-1424-4022-8771-f2c1a152a365-be6957c3-fd42-44ca-a25c-33a757a9e234" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Creating volume be6957c3-fd42-44ca-a25c-33a757a9e234 from snapshot eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-be6957c3-fd42-44ca-a25c-33a757a9e234" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-be6957c3-fd42-44ca-a25c-33a757a9e234" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] snapshot: eef491ec-1424-4022-8771-f2c1a152a365, volume: be6957c3-fd42-44ca-a25c-33a757a9e234, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[211acc19-2d68-4573-b502-482fc288fde0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:00 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 Sep 28 15:12:00 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Flow 'volume_create_manager' (30103351-e069-43d5-903f-823cfe443947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2259d477-50f5-44ca-8c9d-d28df2965f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2259d477-50f5-44ca-8c9d-d28df2965f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1138990040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227b3a75-3f9e-493b-a79e-99b819dfe819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55740a8a11c4a8da053bce514fcde6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:00Z,use_quota=True,user_id='7d1538791d9e4afca2a637beb3c705e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a539d53d-a789-478d-b3a2-8b778171b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a539d53d-a789-478d-b3a2-8b778171b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a5d400-3ffe-4223-9a1e-86ea1242c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a5d400-3ffe-4223-9a1e-86ea1242c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227b3a75-3f9e-493b-a79e-99b819dfe819', 'volume_name': 'volume-227b3a75-3f9e-493b-a79e-99b819dfe819', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7580051-31f3-4aa4-ba02-e6d3ff41a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7580051-31f3-4aa4-ba02-e6d3ff41a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92f9ac4-5429-4b18-a4ea-dc7e1d9da3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Volume 227b3a75-3f9e-493b-a79e-99b819dfe819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227b3a75-3f9e-493b-a79e-99b819dfe819', 'volume_size': 1} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:00 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365" returned: 0 in 0.535s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73ddce1c-3496-4857-937e-af04ca744311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5710113f-e66d-44c4-82f7-eb904de3e2ad]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:00 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 Sep 28 15:12:00 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:01 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311" returned: 0 in 0.485s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:12:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:12:01 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:12:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:01 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 Sep 28 15:12:01 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234" returned: 0 in 8.241s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:12:09 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Converted 1024.00 MB image at 124.23 MB/s Sep 28 15:12:09 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 is being set with open permissions: ugo+rw Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 Sep 28 15:12:09 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234" returned: 0 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-be6957c3-fd42-44ca-a25c-33a757a9e234" released by "_copy_volume_from_snapshot" :: held 9.784s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-eef491ec-1424-4022-8771-f2c1a152a365-be6957c3-fd42-44ca-a25c-33a757a9e234" released by "_create_volume_from_snapshot" :: held 9.896s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.931s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.300s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1138990040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227b3a75-3f9e-493b-a79e-99b819dfe819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55740a8a11c4a8da053bce514fcde6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:00Z,use_quota=True,user_id='7d1538791d9e4afca2a637beb3c705e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Creating volume 227b3a75-3f9e-493b-a79e-99b819dfe819 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:09 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 1073741824 Sep 28 15:12:09 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf88ec8-8ef9-4bc3-938a-59fd38f27164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6957c3-fd42-44ca-a25c-33a757a9e234', 'volume_size': 1, 'snapshot_id': 'eef491ec-1424-4022-8771-f2c1a152a365'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb809f-d14e-495d-976e-b2986240a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Volume volume-be6957c3-fd42-44ca-a25c-33a757a9e234 (be6957c3-fd42-44ca-a25c-33a757a9e234): created successfully Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb809f-d14e-495d-976e-b2986240a59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Flow 'volume_create_manager' (2e006c88-6b31-4ad2-975a-9767c4e3740c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-67566de4-1c65-4c64-a3d6-4291389c26d1 tempest-VolumesSnapshotTestJSON-483827991 None] Created volume successfully. Sep 28 15:12:10 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 1073741824" returned: 0 in 0.700s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:10 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 Sep 28 15:12:10 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:10 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-be6957c3-fd42-44ca-a25c-33a757a9e234-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819" returned: 0 in 0.415s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92f9ac4-5429-4b18-a4ea-dc7e1d9da3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227b3a75-3f9e-493b-a79e-99b819dfe819', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f508fd9-e348-4d76-9e22-68b204cf7477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-be6957c3-fd42-44ca-a25c-33a757a9e234-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:11 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Volume volume-227b3a75-3f9e-493b-a79e-99b819dfe819 (227b3a75-3f9e-493b-a79e-99b819dfe819): created successfully Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f508fd9-e348-4d76-9e22-68b204cf7477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Flow 'volume_create_manager' (30103351-e069-43d5-903f-823cfe443947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ac02ba99-8217-4639-83b5-1eac0394cd1a tempest-VolumesTransfersV357Test-1504122407 None] Created volume successfully. Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-be6957c3-fd42-44ca-a25c-33a757a9e234" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-be6957c3-fd42-44ca-a25c-33a757a9e234" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf28ba26-b039-4b8e-9465-5e32c97c4a0c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:11 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 Sep 28 15:12:11 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:11 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234" returned: 0 in 0.570s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:11 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234 Sep 28 15:12:11 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:12 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-be6957c3-fd42-44ca-a25c-33a757a9e234" returned: 0 in 0.424s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-be6957c3-fd42-44ca-a25c-33a757a9e234" released by "delete_volume" :: held 1.063s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['1619e5eb-8bd1-42c4-99fa-8671afe45df0', '4051f3f5-1fe1-4330-a0e3-48b5faf6dbdf', '085fef05-4813-486d-9de7-ebcb2b6b9d9e', 'd2023e9e-ec2b-4079-b995-69b2fee50aaa'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:12 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:12 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:12 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.412s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Deleted volume successfully. Sep 28 15:12:12 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:INSERT=31,cinder:UPDATE=140,cinder:SELECT=106,cinder:DELETE=10 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-80e6a08a-0a49-47e1-be1c-612fc1250605 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-be6957c3-fd42-44ca-a25c-33a757a9e234-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=107,cinder:UPDATE=124,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d9edaa7f-4a67-4ad9-a364-ef6cd24d02c2 tempest-VolumesTransfersV357Test-1738120827 None] Transfer volume completed successfully. Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-eef491ec-1424-4022-8771-f2c1a152a365-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-eef491ec-1424-4022-8771-f2c1a152a365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-73ddce1c-3496-4857-937e-af04ca744311" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-73ddce1c-3496-4857-937e-af04ca744311" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-eef491ec-1424-4022-8771-f2c1a152a365" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-eef491ec-1424-4022-8771-f2c1a152a365" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Deleting offline snapshot eef491ec-1424-4022-8771-f2c1a152a365 of volume 73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] snapshot_file for this snap is: volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[67664d96-a3ee-4f89-b63f-e0b46cc67f39]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-2a013bc1-4d96-492b-9849-d29193709455 req-71b2a81e-749f-42e8-b0ca-5abfe19cd971 tempest-TestMinimumBasicScenario-2019900524 None] Terminate volume connection completed successfully. Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-2a013bc1-4d96-492b-9849-d29193709455 req-71b2a81e-749f-42e8-b0ca-5abfe19cd971 tempest-TestMinimumBasicScenario-2019900524 None] Deleting attachment 7a588d31-2817-4b00-b923-b47c38fa59e7. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:12:14 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 Sep 28 15:12:14 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:14 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365" returned: 0 in 0.820s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73ddce1c-3496-4857-937e-af04ca744311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Acquiring lock "cinder-227b3a75-3f9e-493b-a79e-99b819dfe819-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca78bb-3f13-4047-b856-700db3ee62ce]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-227b3a75-3f9e-493b-a79e-99b819dfe819-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Acquiring lock "cinder-quobyte-227b3a75-3f9e-493b-a79e-99b819dfe819" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-quobyte-227b3a75-3f9e-493b-a79e-99b819dfe819" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcb8926-74d7-4cb1-af4a-fc6ed077edd5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 Sep 28 15:12:14 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 Sep 28 15:12:15 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819" returned: 0 in 0.600s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819 Sep 28 15:12:15 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Acquiring lock "cinder-4883ba93-1259-468b-b708-92efe0903b1a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:15 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311" returned: 0 in 0.898s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Lock "cinder-4883ba93-1259-468b-b708-92efe0903b1a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:15 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 Sep 28 15:12:15 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Acquiring lock "cinder-quobyte-4883ba93-1259-468b-b708-92efe0903b1a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Lock "cinder-quobyte-4883ba93-1259-468b-b708-92efe0903b1a" acquired by "delete_volume" :: waited 0.047s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d4ff74-7c38-4fa7-9a08-b85cd1946cfa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-227b3a75-3f9e-493b-a79e-99b819dfe819" returned: 0 in 0.469s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-quobyte-227b3a75-3f9e-493b-a79e-99b819dfe819" released by "delete_volume" :: held 1.144s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a Sep 28 15:12:16 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Created reservations ['ba4b7b3a-3f51-4e53-a875-0cf8576ac121', 'f18cfe59-315e-4a27-b212-54602b92fbff', '922ad37b-f38a-4bfe-9664-ef7129ca60d6', '7400bf78-1c73-45dd-b519-3994e9f5b02f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:16 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365" returned: 0 in 0.718s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365 Sep 28 15:12:16 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Deleted volume successfully. Sep 28 15:12:16 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a" returned: 0 in 0.818s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d5e90061-8be5-48d0-8a79-fba84a84aae1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-227b3a75-3f9e-493b-a79e-99b819dfe819-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a Sep 28 15:12:16 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311.eef491ec-1424-4022-8771-f2c1a152a365" returned: 0 in 0.491s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-eef491ec-1424-4022-8771-f2c1a152a365" released by "_delete_snapshot" :: held 3.130s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-73ddce1c-3496-4857-937e-af04ca744311" released by "delete_snapshot" :: held 3.164s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['9a410a59-3a41-420d-b54a-5bff875aa856', 'c848b550-ad60-4d94-b26f-ba19350ae049', '9ac96b8c-25df-4ffc-be06-e0bb65b36e34', '2da93bc8-843b-41c9-8d73-b95dc812167e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:17 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4883ba93-1259-468b-b708-92efe0903b1a" returned: 0 in 0.396s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Lock "cinder-quobyte-4883ba93-1259-468b-b708-92efe0903b1a" released by "delete_volume" :: held 1.338s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Delete snapshot completed successfully. Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a6d8397-3c6c-4599-aad4-99a319854a37 tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-eef491ec-1424-4022-8771-f2c1a152a365-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Created reservations ['b4b5fae3-45ff-4849-ba2f-8fbcfdf0c25a', 'cc9c625b-119b-4e5a-924d-9bb5d5ef9f50', '5b6c7e7d-13e7-4d0c-a3c6-93ee16c80015', '420e673e-a722-4cfc-bb30-07f78f0ca990'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:17 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:17 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.382s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Deleted volume successfully. Sep 28 15:12:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-54899c2f-3a5b-4165-9a9b-7396df6ac75c tempest-TestMinimumBasicScenario-2019900524 None] Lock "cinder-4883ba93-1259-468b-b708-92efe0903b1a-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Flow 'volume_create_manager' (01f16dfd-7d08-4e8e-ab15-7d95be4485fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb20534-d6f3-4579-b5c2-d0b812d874c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb20534-d6f3-4579-b5c2-d0b812d874c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-791986373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8d6b67-5140-46a4-b055-5b1928f4bd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55740a8a11c4a8da053bce514fcde6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:18Z,use_quota=True,user_id='7d1538791d9e4afca2a637beb3c705e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea82b7e7-2f6b-475b-80cd-cbb5c644eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea82b7e7-2f6b-475b-80cd-cbb5c644eb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ec85c1-8d21-4ebd-968b-9936fda4724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ec85c1-8d21-4ebd-968b-9936fda4724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8d6b67-5140-46a4-b055-5b1928f4bd7b', 'volume_name': 'volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fafbe3-7bd3-4a75-b6c5-151dcee596c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fafbe3-7bd3-4a75-b6c5-151dcee596c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c65ddd-1aef-4dee-9392-9606a2f6552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Volume 1f8d6b67-5140-46a4-b055-5b1928f4bd7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b', 'volume_size': 1} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-791986373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8d6b67-5140-46a4-b055-5b1928f4bd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55740a8a11c4a8da053bce514fcde6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:18Z,use_quota=True,user_id='7d1538791d9e4afca2a637beb3c705e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Creating volume 1f8d6b67-5140-46a4-b055-5b1928f4bd7b {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:18 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:18 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b 1073741824 Sep 28 15:12:18 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-73ddce1c-3496-4857-937e-af04ca744311-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-73ddce1c-3496-4857-937e-af04ca744311-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-73ddce1c-3496-4857-937e-af04ca744311" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-73ddce1c-3496-4857-937e-af04ca744311" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb2cb0-5619-417d-b9fd-6d39b487eb44]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:18 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 Sep 28 15:12:18 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:19 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b 1073741824" returned: 0 in 0.937s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:19 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b Sep 28 15:12:19 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:19 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311" returned: 0 in 0.827s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:19 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311 Sep 28 15:12:19 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:19 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b" returned: 0 in 0.375s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c65ddd-1aef-4dee-9392-9606a2f6552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c632c2f7-9332-4748-8c24-5fa49ee0392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:19 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Volume volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b (1f8d6b67-5140-46a4-b055-5b1928f4bd7b): created successfully Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c632c2f7-9332-4748-8c24-5fa49ee0392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Flow 'volume_create_manager' (01f16dfd-7d08-4e8e-ab15-7d95be4485fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3e2031fd-ae90-4d1b-aa9d-2a61a6d76816 tempest-VolumesTransfersV357Test-1504122407 None] Created volume successfully. Sep 28 15:12:20 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-73ddce1c-3496-4857-937e-af04ca744311" returned: 0 in 0.593s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-73ddce1c-3496-4857-937e-af04ca744311" released by "delete_volume" :: held 1.544s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['b0c04d30-0fbc-4519-88cb-006b73f86a07', 'e926224e-acb9-4284-b0fe-5ac634be1f36', 'd9ad7a0d-78e0-49e1-ae60-1cc03662743f', '83ddd08e-8fc0-48dd-ab99-d77e820b313e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:20 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:20 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Acquiring lock "cinder-1f8d6b67-5140-46a4-b055-5b1928f4bd7b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:20 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-1f8d6b67-5140-46a4-b055-5b1928f4bd7b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-83325042-e830-406a-b087-59b9a545647d-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Deleted volume successfully. Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-83325042-e830-406a-b087-59b9a545647d-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Acquiring lock "cinder-quobyte-1f8d6b67-5140-46a4-b055-5b1928f4bd7b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cd1b2884-58c1-4b4e-9694-031c94c46dcf tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-73ddce1c-3496-4857-937e-af04ca744311-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-quobyte-1f8d6b67-5140-46a4-b055-5b1928f4bd7b" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "cinder-quobyte-83325042-e830-406a-b087-59b9a545647d" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c6b503-13db-47c4-845e-a7a99bc75ad3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-83325042-e830-406a-b087-59b9a545647d" acquired by "delete_volume" :: waited 0.069s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:21 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab21625-d5ad-4760-a8b5-fb3858df83a8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:21 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d Sep 28 15:12:21 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:21 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b" returned: 0 in 0.564s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b Sep 28 15:12:21 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:21 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d" returned: 0 in 0.645s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d Sep 28 15:12:21 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1f8d6b67-5140-46a4-b055-5b1928f4bd7b" returned: 0 in 0.488s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-quobyte-1f8d6b67-5140-46a4-b055-5b1928f4bd7b" released by "delete_volume" :: held 1.132s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Created reservations ['7a0dd188-f3c5-4a3e-9167-14db20ece290', '44843946-8dda-4be1-898d-f8ececa4742f', '595edf8b-287f-44a0-89da-98718f08b776', '671beb83-bc2e-4994-9b96-d23e81b80482'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:22 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-83325042-e830-406a-b087-59b9a545647d" returned: 0 in 0.462s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-quobyte-83325042-e830-406a-b087-59b9a545647d" released by "delete_volume" :: held 1.251s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:22 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:22 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Created reservations ['c1e27a7c-3576-4551-b9df-bb23751da98c', '59fe2191-9f48-40b6-b73f-45b99e54d4d5', '55928516-26da-453c-8c11-2be4bd7ecf9f', 'ebc351e2-7ce5-44c1-a309-f47ecdcc63b2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:22 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:22 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.326s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:22 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Deleted volume successfully. Sep 28 15:12:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-63cf9027-1a82-4aba-a15a-871db193f1c1 tempest-VolumesTransfersV357Test-369861264 None] Lock "cinder-1f8d6b67-5140-46a4-b055-5b1928f4bd7b-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:23 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.288s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:23 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Deleted volume successfully. Sep 28 15:12:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1c3c5d71-1de1-4617-bff6-b3c96e18986f tempest-VolumesSnapshotTestJSON-483827991 None] Lock "cinder-83325042-e830-406a-b087-59b9a545647d-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Flow 'volume_create_manager' (273cfdf8-91f5-4e23-8b49-1c14593e9cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40755a0d-1050-4006-8345-c35823ffbccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40755a0d-1050-4006-8345-c35823ffbccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-80666440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990ae683-5cf8-4e21-ac97-8de112b5b45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b791bf014e84513adb9cac45725453d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:26Z,use_quota=True,user_id='4b477aa8cecc4561bd71b699ee930dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36bc96b9-ff1a-4bb5-a732-b8dd70bc15d0),volume_type_id=36bc96b9-ff1a-4bb5-a732-b8dd70bc15d0)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3196077-0e51-45e5-bc65-5b0022d1f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3196077-0e51-45e5-bc65-5b0022d1f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693cf1c1-a952-4b16-bd88-fd7ab0c41d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693cf1c1-a952-4b16-bd88-fd7ab0c41d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990ae683-5cf8-4e21-ac97-8de112b5b45c', 'volume_name': 'volume-990ae683-5cf8-4e21-ac97-8de112b5b45c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc0b583-5455-4c37-9bd1-bbff75df929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc0b583-5455-4c37-9bd1-bbff75df929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f311612-35d6-4f13-9ee0-c0af12b6ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume 990ae683-5cf8-4e21-ac97-8de112b5b45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990ae683-5cf8-4e21-ac97-8de112b5b45c', 'volume_size': 1} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-80666440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990ae683-5cf8-4e21-ac97-8de112b5b45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b791bf014e84513adb9cac45725453d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:26Z,use_quota=True,user_id='4b477aa8cecc4561bd71b699ee930dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36bc96b9-ff1a-4bb5-a732-b8dd70bc15d0),volume_type_id=36bc96b9-ff1a-4bb5-a732-b8dd70bc15d0)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Creating volume 990ae683-5cf8-4e21-ac97-8de112b5b45c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:26 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:26 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c 1073741824 Sep 28 15:12:26 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Flow 'volume_create_manager' (86f52cef-f128-4f93-b85a-7bf2dcdbea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4647bcd7-31f4-40db-9b3a-93b79294e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4647bcd7-31f4-40db-9b3a-93b79294e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1213392222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1aaea0c-ba42-4c22-9891-46f397a9c00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b791bf014e84513adb9cac45725453d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:27Z,use_quota=True,user_id='4b477aa8cecc4561bd71b699ee930dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c0321e4-7391-4a4c-ad8d-4ffc23b1581e),volume_type_id=1c0321e4-7391-4a4c-ad8d-4ffc23b1581e)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac0b439-6dec-4ff3-8e3a-0945ca1c4861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac0b439-6dec-4ff3-8e3a-0945ca1c4861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e193ebc-1c09-4e99-881c-0dea1a34ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e193ebc-1c09-4e99-881c-0dea1a34ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1aaea0c-ba42-4c22-9891-46f397a9c00e', 'volume_name': 'volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56079ca6-5286-4722-8828-e3af632129e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56079ca6-5286-4722-8828-e3af632129e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ddad78-7c72-4241-a8af-b069c70599b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume e1aaea0c-ba42-4c22-9891-46f397a9c00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e', 'volume_size': 1} Sep 28 15:12:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:27 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c 1073741824" returned: 0 in 0.810s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:27 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c Sep 28 15:12:27 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:27 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c" returned: 0 in 0.551s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1213392222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1aaea0c-ba42-4c22-9891-46f397a9c00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b791bf014e84513adb9cac45725453d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:27Z,use_quota=True,user_id='4b477aa8cecc4561bd71b699ee930dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c0321e4-7391-4a4c-ad8d-4ffc23b1581e),volume_type_id=1c0321e4-7391-4a4c-ad8d-4ffc23b1581e)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Creating volume e1aaea0c-ba42-4c22-9891-46f397a9c00e {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:27 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:27 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e 1073741824 Sep 28 15:12:27 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f311612-35d6-4f13-9ee0-c0af12b6ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990ae683-5cf8-4e21-ac97-8de112b5b45c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbefdd5-9fde-4308-b368-f99e577098e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:27 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume volume-990ae683-5cf8-4e21-ac97-8de112b5b45c (990ae683-5cf8-4e21-ac97-8de112b5b45c): created successfully Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbefdd5-9fde-4308-b368-f99e577098e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Flow 'volume_create_manager' (273cfdf8-91f5-4e23-8b49-1c14593e9cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-30f22c4c-2384-4a7e-a429-129ea6f8d416 tempest-TestInstancesWithCinderVolumes-830488151 None] Created volume successfully. Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Flow 'volume_create_manager' (bee5deba-eec8-4325-9282-651b119397bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d88a0e-a688-4132-a452-e0e126f63d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d88a0e-a688-4132-a452-e0e126f63d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1119398452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cadd40-32c5-41b6-9af5-828bf6553746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b791bf014e84513adb9cac45725453d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:28Z,use_quota=True,user_id='4b477aa8cecc4561bd71b699ee930dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2311ad84-a9e5-4b29-9af2-083435cc2d4e),volume_type_id=2311ad84-a9e5-4b29-9af2-083435cc2d4e)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d15573-8cfb-43dd-ac53-75feb6353053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d15573-8cfb-43dd-ac53-75feb6353053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8fffb8-4988-4e95-9f8c-2599444309f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:12:28 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e 1073741824" returned: 0 in 0.720s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8fffb8-4988-4e95-9f8c-2599444309f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50cadd40-32c5-41b6-9af5-828bf6553746', 'volume_name': 'volume-50cadd40-32c5-41b6-9af5-828bf6553746', 'volume_size': 1, 'image_id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1117118341', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b791bf014e84513adb9cac45725453d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'created_at': datetime.datetime(2026, 9, 28, 13, 12, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 12, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0/file', 'properties': {}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000d1a8d-adaf-4018-b88e-2bce13369aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000d1a8d-adaf-4018-b88e-2bce13369aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5a2526-9552-402e-9931-aa423932adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume 50cadd40-32c5-41b6-9af5-828bf6553746: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50cadd40-32c5-41b6-9af5-828bf6553746', 'volume_size': 1, 'image_id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1117118341', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b791bf014e84513adb9cac45725453d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'created_at': datetime.datetime(2026, 9, 28, 13, 12, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 12, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0/file', 'properties': {}}, 'image_service': } Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Trying to clone 50cadd40-32c5-41b6-9af5-828bf6553746 from image e8f0c8e6-664b-496a-8196-b8e74b83f7c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:12:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:28 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e Sep 28 15:12:28 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:29 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e" returned: 0 in 0.448s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ddad78-7c72-4241-a8af-b069c70599b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b55f45a-47a3-46b8-a1ba-37922e014b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e (e1aaea0c-ba42-4c22-9891-46f397a9c00e): created successfully Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b55f45a-47a3-46b8-a1ba-37922e014b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Flow 'volume_create_manager' (86f52cef-f128-4f93-b85a-7bf2dcdbea77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-60fa9d94-26d6-47a9-a0a6-ff8d933f4e45 tempest-TestInstancesWithCinderVolumes-830488151 None] Created volume successfully. Sep 28 15:12:33 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD, size 20.69 MB, duration 5.19 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:12:33 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Image download 20.69 MB at 3.98 MB/s Sep 28 15:12:33 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f988c99-dae3-4462-8445-8b4cb6f4cdd8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD Sep 28 15:12:34 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Temporary image e8f0c8e6-664b-496a-8196-b8e74b83f7c0 is fetched for user 4b477aa8cecc4561bd71b699ee930dfc. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[399068f1-44e3-48de-a5f9-3fe0ff5ae372]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD Sep 28 15:12:34 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1119398452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cadd40-32c5-41b6-9af5-828bf6553746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b791bf014e84513adb9cac45725453d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:28Z,use_quota=True,user_id='4b477aa8cecc4561bd71b699ee930dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2311ad84-a9e5-4b29-9af2-083435cc2d4e),volume_type_id=2311ad84-a9e5-4b29-9af2-083435cc2d4e)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Creating volume 50cadd40-32c5-41b6-9af5-828bf6553746 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:34 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:12:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 1073741824 Sep 28 15:12:34 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:35 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 1073741824" returned: 0 in 0.667s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:35 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 Sep 28 15:12:35 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:36 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746" returned: 0 in 0.325s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Attempting download of e8f0c8e6-664b-496a-8196-b8e74b83f7c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'metadata': {}}])) to volume 50cadd40-32c5-41b6-9af5-828bf6553746. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cae989-ab65-4c5e-b271-f9c6db778d20]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:36 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y Sep 28 15:12:36 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:36 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y" returned: 0 in 0.568s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:36 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y Sep 28 15:12:36 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:37 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y" returned: 1 in 0.480s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_9wrxjs9y' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e471f-4ca9-4c37-9528-a0c52c07f020]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:37 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:12:37 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:37 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD Sep 28 15:12:37 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:37 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.474s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:37 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] e8f0c8e6-664b-496a-8196-b8e74b83f7c0 was qcow2, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:12:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:12:37 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 Sep 28 15:12:37 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746" returned: 0 in 2.691s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8f0c8e6-664b-496a-8196-b8e74b83f7c0_xs39v1k_devstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:12:40 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Converted 112.00 MB image at 41.58 MB/s Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 1G Sep 28 15:12:40 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 1G" returned: 0 in 0.438s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Downloaded image e8f0c8e6-664b-496a-8196-b8e74b83f7c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'metadata': {}}])) to volume 50cadd40-32c5-41b6-9af5-828bf6553746 successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Temporary image e8f0c8e6-664b-496a-8196-b8e74b83f7c0 for user 4b477aa8cecc4561bd71b699ee930dfc is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:12:40 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Marking volume 50cadd40-32c5-41b6-9af5-828bf6553746 as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:12:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Copying metadata from image e8f0c8e6-664b-496a-8196-b8e74b83f7c0 to 50cadd40-32c5-41b6-9af5-828bf6553746. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:12:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Creating volume glance metadata for volume 50cadd40-32c5-41b6-9af5-828bf6553746 backed by image e8f0c8e6-664b-496a-8196-b8e74b83f7c0 with: {'image_id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'image_name': 'tempest-scenario-img--1117118341', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:12:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5a2526-9552-402e-9931-aa423932adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50cadd40-32c5-41b6-9af5-828bf6553746', 'volume_size': 1, 'image_id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1117118341', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b791bf014e84513adb9cac45725453d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e8f0c8e6-664b-496a-8196-b8e74b83f7c0', 'created_at': datetime.datetime(2026, 9, 28, 13, 12, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 12, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8f0c8e6-664b-496a-8196-b8e74b83f7c0/file', 'properties': {}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63075b6-b6bc-43d1-92d9-cea564dfdc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Volume volume-50cadd40-32c5-41b6-9af5-828bf6553746 (50cadd40-32c5-41b6-9af5-828bf6553746): created successfully Sep 28 15:12:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63075b6-b6bc-43d1-92d9-cea564dfdc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Flow 'volume_create_manager' (bee5deba-eec8-4325-9282-651b119397bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:41 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e55f9271-1389-4b33-9c2a-603d0d07d0d7 tempest-TestInstancesWithCinderVolumes-830488151 None] Created volume successfully. Sep 28 15:12:51 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=38,cinder:UPDATE=58,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:51 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=52,cinder:UPDATE=60,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Flow 'volume_create_manager' (5d1bcbd7-9057-4800-8751-d5efc83366b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fee3a1a-8738-490e-b87c-5e37e2448e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fee3a1a-8738-490e-b87c-5e37e2448e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718471656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb5023f-b291-4183-8769-d97255760dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23346bd66a6b4a73819a4be5b9cf5f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:55Z,use_quota=True,user_id='c7f066f1dd22418ebc0ac398bb30815f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e6d233-0235-41e7-bcce-d9504dea46c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e6d233-0235-41e7-bcce-d9504dea46c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf0dbf1-7964-482d-a902-79d527b121f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf0dbf1-7964-482d-a902-79d527b121f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb5023f-b291-4183-8769-d97255760dd5', 'volume_name': 'volume-cbb5023f-b291-4183-8769-d97255760dd5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc81097b-e870-4ebe-b816-117a3a021e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc81097b-e870-4ebe-b816-117a3a021e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20e817b-6b28-4433-844d-8f5c536ce13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Volume cbb5023f-b291-4183-8769-d97255760dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb5023f-b291-4183-8769-d97255760dd5', 'volume_size': 1} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718471656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb5023f-b291-4183-8769-d97255760dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23346bd66a6b4a73819a4be5b9cf5f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:55Z,use_quota=True,user_id='c7f066f1dd22418ebc0ac398bb30815f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Creating volume cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:54 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:12:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 1073741824 Sep 28 15:12:54 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-f09befce-fa7c-43a7-92cc-7f4d68cc2807 req-1a2fd965-91c9-47c9-b309-a50d50c09647 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:55 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 1073741824" returned: 0 in 0.821s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:55 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:12:55 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:56 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.342s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-f09befce-fa7c-43a7-92cc-7f4d68cc2807 req-1a2fd965-91c9-47c9-b309-a50d50c09647 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.534s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-f09befce-fa7c-43a7-92cc-7f4d68cc2807 req-1a2fd965-91c9-47c9-b309-a50d50c09647 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20e817b-6b28-4433-844d-8f5c536ce13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb5023f-b291-4183-8769-d97255760dd5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85c9906-9f80-4c23-866d-ed4ba119c735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:56 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Volume volume-cbb5023f-b291-4183-8769-d97255760dd5 (cbb5023f-b291-4183-8769-d97255760dd5): created successfully Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85c9906-9f80-4c23-866d-ed4ba119c735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Flow 'volume_create_manager' (5d1bcbd7-9057-4800-8751-d5efc83366b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bd2fdb2e-0e49-47aa-942a-d24d50bebcc6 tempest-VolumesActionsTest-505726007 None] Created volume successfully. Sep 28 15:12:56 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-f09befce-fa7c-43a7-92cc-7f4d68cc2807 req-1a2fd965-91c9-47c9-b309-a50d50c09647 tempest-TestInstancesWithCinderVolumes-830488151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-50cadd40-32c5-41b6-9af5-828bf6553746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acda9bb2-db73-4d2a-ba7d-c67a2749386a', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:12:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-f09befce-fa7c-43a7-92cc-7f4d68cc2807 req-1a2fd965-91c9-47c9-b309-a50d50c09647 tempest-TestInstancesWithCinderVolumes-830488151 None] attachment_update completed successfully. Sep 28 15:13:06 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:06 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Flow 'volume_create_manager' (dbce4729-cc91-4a13-abef-8cdc5d7258f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39baebd7-5299-4e8c-b0b2-54f740aee31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39baebd7-5299-4e8c-b0b2-54f740aee31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-497572609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f36045c-cf88-4a60-854b-362f29e58dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a344bf22e184772b8debff74e3eac00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:17Z,use_quota=True,user_id='30c5945494bb4ecaa3774ac5fea91d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c3f66c-5860-4f7a-8ead-acab25c85d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c3f66c-5860-4f7a-8ead-acab25c85d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5f8b4d-ed90-4c95-b382-44a38dbc37ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5f8b4d-ed90-4c95-b382-44a38dbc37ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f36045c-cf88-4a60-854b-362f29e58dae', 'volume_name': 'volume-0f36045c-cf88-4a60-854b-362f29e58dae', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8ac6b3-5235-4f78-997a-67659465554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8ac6b3-5235-4f78-997a-67659465554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a65983-b4c3-48ef-84c6-cc05d2f9cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:16 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Volume 0f36045c-cf88-4a60-854b-362f29e58dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f36045c-cf88-4a60-854b-362f29e58dae', 'volume_size': 1} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-497572609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f36045c-cf88-4a60-854b-362f29e58dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a344bf22e184772b8debff74e3eac00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:17Z,use_quota=True,user_id='30c5945494bb4ecaa3774ac5fea91d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Creating volume 0f36045c-cf88-4a60-854b-362f29e58dae {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:16 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:13:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:17 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae 1073741824 Sep 28 15:13:17 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Flow 'volume_create_manager' (43fde05a-98d0-49ae-8e5b-f224b1e59e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f321ce83-ae32-46d0-9c37-1ed50104f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f321ce83-ae32-46d0-9c37-1ed50104f67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1268952298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255ade72-0e92-4f54-9201-4e2ee6cffe72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a344bf22e184772b8debff74e3eac00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:17Z,use_quota=True,user_id='30c5945494bb4ecaa3774ac5fea91d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fece64d-f283-43c6-b9cb-6bf320b1f5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fece64d-f283-43c6-b9cb-6bf320b1f5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10aaaef-8f7d-411c-86d4-5404683b6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10aaaef-8f7d-411c-86d4-5404683b6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255ade72-0e92-4f54-9201-4e2ee6cffe72', 'volume_name': 'volume-255ade72-0e92-4f54-9201-4e2ee6cffe72', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b359df-6faa-4715-9fe1-727041617bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b359df-6faa-4715-9fe1-727041617bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0ad9d9-7990-4583-aae9-ca589f363e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:17 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Volume 255ade72-0e92-4f54-9201-4e2ee6cffe72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255ade72-0e92-4f54-9201-4e2ee6cffe72', 'volume_size': 1} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:17 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae 1073741824" returned: 0 in 0.683s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:17 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae Sep 28 15:13:17 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae" returned: 0 in 0.783s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1268952298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255ade72-0e92-4f54-9201-4e2ee6cffe72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a344bf22e184772b8debff74e3eac00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:17Z,use_quota=True,user_id='30c5945494bb4ecaa3774ac5fea91d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Creating volume 255ade72-0e92-4f54-9201-4e2ee6cffe72 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:18 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 1073741824 Sep 28 15:13:18 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a65983-b4c3-48ef-84c6-cc05d2f9cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f36045c-cf88-4a60-854b-362f29e58dae', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c12d5-cbf3-4f74-94c7-4fa08998ab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Volume volume-0f36045c-cf88-4a60-854b-362f29e58dae (0f36045c-cf88-4a60-854b-362f29e58dae): created successfully Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c12d5-cbf3-4f74-94c7-4fa08998ab73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Flow 'volume_create_manager' (dbce4729-cc91-4a13-abef-8cdc5d7258f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-720022ef-047d-406c-aa8d-2ee4963fe52c tempest-TestServerVolumeAttachmentScenario-612571412 None] Created volume successfully. Sep 28 15:13:19 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 1073741824" returned: 0 in 0.827s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:19 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 Sep 28 15:13:19 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0ad9d9-7990-4583-aae9-ca589f363e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255ade72-0e92-4f54-9201-4e2ee6cffe72', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc01a421-491e-4d93-a39d-32ac2791cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Volume volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 (255ade72-0e92-4f54-9201-4e2ee6cffe72): created successfully Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc01a421-491e-4d93-a39d-32ac2791cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Flow 'volume_create_manager' (43fde05a-98d0-49ae-8e5b-f224b1e59e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ccc89a7e-df32-4331-bbd9-21356b3b84af tempest-TestServerVolumeAttachmentScenario-612571412 None] Created volume successfully. Sep 28 15:13:30 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:30 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48648497-8ce4-48b5-9361-7346e0bfcb64 tempest-VolumesActionsTest-505726007 None] Acquiring lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5" by "attach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48648497-8ce4-48b5-9361-7346e0bfcb64 tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5" acquired by "attach_volume" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-48648497-8ce4-48b5-9361-7346e0bfcb64 tempest-VolumesActionsTest-505726007 None] Attaching volume cbb5023f-b291-4183-8769-d97255760dd5 to instance 0b558488-e3d6-4b1e-855e-9df040a2d543 at mountpoint /dev/vdb on host None. Sep 28 15:13:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-48648497-8ce4-48b5-9361-7346e0bfcb64 tempest-VolumesActionsTest-505726007 None] Attach volume completed successfully. Sep 28 15:13:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-48648497-8ce4-48b5-9361-7346e0bfcb64 tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5" released by "attach_volume" :: held 0.308s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dfec82a-bb92-40e9-b82a-1da940863b9c tempest-VolumesActionsTest-505726007 None] Acquiring lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-detach_volume" by "detach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dfec82a-bb92-40e9-b82a-1da940863b9c tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-detach_volume" acquired by "detach_volume" :: waited 0.077s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1dfec82a-bb92-40e9-b82a-1da940863b9c tempest-VolumesActionsTest-505726007 None] Detaching volume cbb5023f-b291-4183-8769-d97255760dd5 from instance 0b558488-e3d6-4b1e-855e-9df040a2d543. Sep 28 15:13:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1dfec82a-bb92-40e9-b82a-1da940863b9c tempest-VolumesActionsTest-505726007 None] Detach volume completed successfully. Sep 28 15:13:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dfec82a-bb92-40e9-b82a-1da940863b9c tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-detach_volume" released by "detach_volume" :: held 0.187s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:37 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:13:37 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:37 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.525s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:13:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:13:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-9c884f91-90ba-45d8-8399-f1fed9d852ca req-62990ecc-ea79-4b61-8a01-ae063c2af9d9 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-9c884f91-90ba-45d8-8399-f1fed9d852ca req-62990ecc-ea79-4b61-8a01-ae063c2af9d9 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-9c884f91-90ba-45d8-8399-f1fed9d852ca req-62990ecc-ea79-4b61-8a01-ae063c2af9d9 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-9c884f91-90ba-45d8-8399-f1fed9d852ca req-62990ecc-ea79-4b61-8a01-ae063c2af9d9 tempest-TestInstancesWithCinderVolumes-830488151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-990ae683-5cf8-4e21-ac97-8de112b5b45c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92088f16-e8ea-4f91-a74e-5b7f53ce57c9', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:13:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-9c884f91-90ba-45d8-8399-f1fed9d852ca req-62990ecc-ea79-4b61-8a01-ae063c2af9d9 tempest-TestInstancesWithCinderVolumes-830488151 None] attachment_update completed successfully. Sep 28 15:14:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7d81412c-0dd7-4c77-ae06-1350609d047b tempest-VolumesActionsTest-505726007 None] Acquiring lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5" by "attach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7d81412c-0dd7-4c77-ae06-1350609d047b tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5" acquired by "attach_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7d81412c-0dd7-4c77-ae06-1350609d047b tempest-VolumesActionsTest-505726007 None] Attaching volume cbb5023f-b291-4183-8769-d97255760dd5 to instance 1660f961-1217-4e48-9926-8fb255ee896a at mountpoint /dev/vdb on host None. Sep 28 15:14:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7d81412c-0dd7-4c77-ae06-1350609d047b tempest-VolumesActionsTest-505726007 None] Attach volume completed successfully. Sep 28 15:14:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7d81412c-0dd7-4c77-ae06-1350609d047b tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5" released by "attach_volume" :: held 0.212s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-de8fb118-0453-433c-ad33-25de1ab00d87 tempest-VolumesActionsTest-505726007 None] Acquiring lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-detach_volume" by "detach_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-de8fb118-0453-433c-ad33-25de1ab00d87 tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-de8fb118-0453-433c-ad33-25de1ab00d87 tempest-VolumesActionsTest-505726007 None] Detaching volume cbb5023f-b291-4183-8769-d97255760dd5 from instance 1660f961-1217-4e48-9926-8fb255ee896a. Sep 28 15:14:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-de8fb118-0453-433c-ad33-25de1ab00d87 tempest-VolumesActionsTest-505726007 None] Detach volume completed successfully. Sep 28 15:14:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-de8fb118-0453-433c-ad33-25de1ab00d87 tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-detach_volume" released by "detach_volume" :: held 0.191s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-fba58629-b688-4fe5-b856-ccd619d98b41 req-7ada9e33-0f54-45c2-a505-680760e72860 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-fba58629-b688-4fe5-b856-ccd619d98b41 req-7ada9e33-0f54-45c2-a505-680760e72860 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-fba58629-b688-4fe5-b856-ccd619d98b41 req-7ada9e33-0f54-45c2-a505-680760e72860 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-fba58629-b688-4fe5-b856-ccd619d98b41 req-7ada9e33-0f54-45c2-a505-680760e72860 tempest-TestInstancesWithCinderVolumes-830488151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4602563f-088a-411a-b14a-58e01372177d', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:04 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-fba58629-b688-4fe5-b856-ccd619d98b41 req-7ada9e33-0f54-45c2-a505-680760e72860 tempest-TestInstancesWithCinderVolumes-830488151 None] attachment_update completed successfully. Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62db0cd-487d-4d51-909f-b7dafbf4ad82]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:11 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:14:11 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:11 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.403s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef46b2-2815-47a6-8068-9d04f04b0851]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:11 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:14:11 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.737s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.603e7e20-684e-492c-a5e7-71fd428d061bb1exs3j9.img {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.603e7e20-684e-492c-a5e7-71fd428d061bb1exs3j9.img Sep 28 15:14:12 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-9dcb1a54-1ab2-4511-a1af-50f0617c138d req-8874f341-9c4c-418c-8346-0919a935766d tempest-TestInstancesWithCinderVolumes-830488151 None] Terminate volume connection completed successfully. Sep 28 15:14:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-9dcb1a54-1ab2-4511-a1af-50f0617c138d req-8874f341-9c4c-418c-8346-0919a935766d tempest-TestInstancesWithCinderVolumes-830488151 None] Deleting attachment 92088f16-e8ea-4f91-a74e-5b7f53ce57c9. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:14 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "cinder-990ae683-5cf8-4e21-ac97-8de112b5b45c-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-990ae683-5cf8-4e21-ac97-8de112b5b45c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "cinder-quobyte-990ae683-5cf8-4e21-ac97-8de112b5b45c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-quobyte-990ae683-5cf8-4e21-ac97-8de112b5b45c" acquired by "delete_volume" :: waited 0.057s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f334f4-6c1f-4422-8d41-bcf9892bdb06]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:15 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c Sep 28 15:14:15 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:16 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c" returned: 0 in 1.161s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:16 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c Sep 28 15:14:16 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:17 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-990ae683-5cf8-4e21-ac97-8de112b5b45c" returned: 0 in 0.899s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-quobyte-990ae683-5cf8-4e21-ac97-8de112b5b45c" released by "delete_volume" :: held 2.205s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:17 devstack cinder-volume[87124]: WARNING cinder.quota [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400332824-569529056 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400332824-569529056, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:17 devstack cinder-volume[87124]: WARNING cinder.quota [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400332824-569529056 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1400332824-569529056, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Created reservations ['846df86c-20cc-4494-84e2-84a30d9d1326', 'a15999cc-964e-4b4f-8ffc-dce7059ce542', '12bcf64c-ffad-4761-a454-7d570fd96dde', 'd8858fb3-757b-411b-8d5a-1a6238057cc6'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:14:17 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:18 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.640s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:18 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Deleted volume successfully. Sep 28 15:14:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b0efbe0d-1ccb-40e4-aada-7f82a96b1082 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-990ae683-5cf8-4e21-ac97-8de112b5b45c-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-891e7a72-d9d1-47aa-a620-69a9150cc2eb req-966fad56-5ed6-4a44-8f9f-112b1fa9808e tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:21 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.603e7e20-684e-492c-a5e7-71fd428d061bb1exs3j9.img" returned: 0 in 9.324s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f95a3-c48d-4514-9fdf-114e7b61e9a6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-e141d89e-4a20-4eb3-9115-70bbf780b322 req-83def278-63dd-4619-b509-3ae6a163edd3 tempest-TestInstancesWithCinderVolumes-830488151 None] Terminate volume connection completed successfully. Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-e141d89e-4a20-4eb3-9115-70bbf780b322 req-83def278-63dd-4619-b509-3ae6a163edd3 tempest-TestInstancesWithCinderVolumes-830488151 None] Deleting attachment 4602563f-088a-411a-b14a-58e01372177d. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:21 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:14:21 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "cinder-e1aaea0c-ba42-4c22-9891-46f397a9c00e-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-e1aaea0c-ba42-4c22-9891-46f397a9c00e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "cinder-quobyte-e1aaea0c-ba42-4c22-9891-46f397a9c00e" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-quobyte-e1aaea0c-ba42-4c22-9891-46f397a9c00e" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d20515-c821-4bb9-aec1-390d9ee32f85]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:22 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e Sep 28 15:14:22 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:22 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.720s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.603e7e20-684e-492c-a5e7-71fd428d061bb1exs3j9.img {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:14:22 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Converted 1024.00 MB image at 109.81 MB/s Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] 603e7e20-684e-492c-a5e7-71fd428d061b was raw, no need to convert to raw {{(pid=87124) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:14:22 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:22 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e Sep 28 15:14:22 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:22 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e1aaea0c-ba42-4c22-9891-46f397a9c00e" returned: 0 in 0.285s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-quobyte-e1aaea0c-ba42-4c22-9891-46f397a9c00e" released by "delete_volume" :: held 0.811s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:22 devstack cinder-volume[87124]: WARNING cinder.quota [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004992585-176284179 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004992585-176284179, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:22 devstack cinder-volume[87124]: WARNING cinder.quota [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004992585-176284179 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004992585-176284179, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Created reservations ['69140bda-15d1-4c9d-b10b-3c3f6431d124', '649956ef-859b-4647-bbfa-86bbef029854', '167b6af9-39e5-43ea-93d3-b787c4db4c9c', 'a449058f-a9b2-477a-a6a1-3fb7b5749fdc'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:23 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:14:23 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:23 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.324s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:23 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Deleted volume successfully. Sep 28 15:14:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-67b6de45-a22e-425d-98d6-43ef0c056913 tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-e1aaea0c-ba42-4c22-9891-46f397a9c00e-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-8edb26a1-b94d-43b0-9e70-6a66a68b49a4 req-7548142a-4ba9-4b47-9250-45088db5ad4c tempest-TestInstancesWithCinderVolumes-830488151 None] Terminate volume connection completed successfully. Sep 28 15:14:27 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-8edb26a1-b94d-43b0-9e70-6a66a68b49a4 req-7548142a-4ba9-4b47-9250-45088db5ad4c tempest-TestInstancesWithCinderVolumes-830488151 None] Deleting attachment acda9bb2-db73-4d2a-ba7d-c67a2749386a. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "cinder-50cadd40-32c5-41b6-9af5-828bf6553746-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-50cadd40-32c5-41b6-9af5-828bf6553746-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "cinder-quobyte-50cadd40-32c5-41b6-9af5-828bf6553746" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-quobyte-50cadd40-32c5-41b6-9af5-828bf6553746" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24abc5f-f558-4bda-8e87-fdf0abfc4873]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Flow 'volume_create_manager' (d125bf38-2b8a-41f8-ba01-c83d0a48489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac03053-6646-49ff-8a0d-9cb43157822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:30 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 Sep 28 15:14:30 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac03053-6646-49ff-8a0d-9cb43157822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-154097697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47f6c88-9c05-4c0d-af9e-5cc682a23b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264d11124a544dc2a0523572b7a00808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:30Z,use_quota=True,user_id='cdcc9422e28d4d4db184d653f8f3685f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c3476-145d-45e7-8d36-04485c940e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c3476-145d-45e7-8d36-04485c940e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da3bf31-1173-4586-a0db-6873e684c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da3bf31-1173-4586-a0db-6873e684c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47f6c88-9c05-4c0d-af9e-5cc682a23b0f', 'volume_name': 'volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db776d6-82e6-4898-82c7-6abddae5d358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db776d6-82e6-4898-82c7-6abddae5d358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548f4511-5c36-481b-8a17-f3fc54b78d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:30 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Volume f47f6c88-9c05-4c0d-af9e-5cc682a23b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f', 'volume_size': 1} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:30 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746" returned: 0 in 0.511s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:30 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746 Sep 28 15:14:30 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:31 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-50cadd40-32c5-41b6-9af5-828bf6553746" returned: 0 in 0.287s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-quobyte-50cadd40-32c5-41b6-9af5-828bf6553746" released by "delete_volume" :: held 0.888s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:31 devstack cinder-volume[87124]: WARNING cinder.quota [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643536037-858489655 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643536037-858489655, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:31 devstack cinder-volume[87124]: WARNING cinder.quota [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643536037-858489655 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643536037-858489655, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Created reservations ['271d84a8-626f-420b-83cc-2f86f6021415', '01e72af8-9324-4c6f-8bbe-c8dc52b6224d', 'f692c771-5ab4-4484-9d5a-cfd443468ff8', '82a482e4-3cdc-418c-89b6-9721904840ef'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:31 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:14:31 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:31 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.334s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Deleted volume successfully. Sep 28 15:14:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-012efc63-e3fc-4217-97cd-f009a6f7d13b tempest-TestInstancesWithCinderVolumes-830488151 None] Lock "cinder-50cadd40-32c5-41b6-9af5-828bf6553746-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:37 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:14:37 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:37 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.438s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 28 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:14:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:14:41 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:41 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=47,cinder:UPDATE=26,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.113s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Uploaded volume to glance image-id: 603e7e20-684e-492c-a5e7-71fd428d061b. {{(pid=87124) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-891e7a72-d9d1-47aa-a620-69a9150cc2eb req-966fad56-5ed6-4a44-8f9f-112b1fa9808e tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.872s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-891e7a72-d9d1-47aa-a620-69a9150cc2eb req-966fad56-5ed6-4a44-8f9f-112b1fa9808e tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.608s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-154097697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47f6c88-9c05-4c0d-af9e-5cc682a23b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264d11124a544dc2a0523572b7a00808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:30Z,use_quota=True,user_id='cdcc9422e28d4d4db184d653f8f3685f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Creating volume f47f6c88-9c05-4c0d-af9e-5cc682a23b0f {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ad198529-638e-4c50-84b6-400a67d429cb tempest-VolumesActionsTest-505726007 None] Copy volume to image completed successfully. Sep 28 15:14:49 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f 1073741824 Sep 28 15:14:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-891e7a72-d9d1-47aa-a620-69a9150cc2eb req-966fad56-5ed6-4a44-8f9f-112b1fa9808e tempest-TestServerVolumeAttachmentScenario-612571412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-0f36045c-cf88-4a60-854b-362f29e58dae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc9c119b-6de4-433c-a5e3-35ae6d03edab', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:49 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-891e7a72-d9d1-47aa-a620-69a9150cc2eb req-966fad56-5ed6-4a44-8f9f-112b1fa9808e tempest-TestServerVolumeAttachmentScenario-612571412 None] attachment_update completed successfully. Sep 28 15:14:50 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f 1073741824" returned: 0 in 0.861s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:50 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f Sep 28 15:14:50 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:50 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f" returned: 0 in 0.425s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548f4511-5c36-481b-8a17-f3fc54b78d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bfb47f-240d-4260-b880-9d8431d4e9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Volume volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f (f47f6c88-9c05-4c0d-af9e-5cc682a23b0f): created successfully Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bfb47f-240d-4260-b880-9d8431d4e9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Flow 'volume_create_manager' (d125bf38-2b8a-41f8-ba01-c83d0a48489e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-90648776-60b8-4140-92b6-28267fdda732 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Created volume successfully. Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752eefb-18a9-4618-a7e1-7460e4f62dac]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:51 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:14:51 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:51 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.574s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[03031f6e-28ff-416c-9fda-9263ba816b2f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:51 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:14:51 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:52 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.602s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:52 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img Sep 28 15:14:52 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-da21ecf9-eab1-4885-85a0-17af039b64b1 req-1c22e449-fe66-4591-9008-c39158c400e0 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-d24f5b2c-ebcf-4cb5-bf49-163309aaa51b req-cb68b9f7-db4a-4cd9-9182-49162434bd6d tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:00 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img" returned: 0 in 8.527s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d56a811-8c0a-4508-8926-5e4a09441480]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:01 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:15:01 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.733s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:01 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:01 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Converted 1024.00 MB image at 120.07 MB/s Sep 28 15:15:01 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] 21e8433f-7bed-4d61-9914-5a7d189be4d8 was raw, converting to qcow2 {{(pid=87124) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 15:15:01 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a87eec-dd7a-4232-b014-0480b655f928]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:01 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img Sep 28 15:15:01 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img" returned: 0 in 0.506s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img Sep 28 15:15:02 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img" returned: 1 in 0.466s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img /opt/stack/data/cinder/conversion/vol_upload_pzgxkste {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img /opt/stack/data/cinder/conversion/vol_upload_pzgxkste Sep 28 15:15:02 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img /opt/stack/data/cinder/conversion/vol_upload_pzgxkste" returned: 0 in 0.310s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Image conversion details: src /opt/stack/data/cinder/conversion/cbb5023f-b291-4183-8769-d97255760dd5.temp_image.21e8433f-7bed-4d61-9914-5a7d189be4d87qbhi386.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pzgxkste {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:02 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d645cf-50e5-4e11-8884-9474c85e77da]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pzgxkste {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:03 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pzgxkste Sep 28 15:15:03 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:03 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pzgxkste" returned: 0 in 0.414s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.124s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Uploaded volume to glance image-id: 21e8433f-7bed-4d61-9914-5a7d189be4d8. {{(pid=87124) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-da21ecf9-eab1-4885-85a0-17af039b64b1 req-1c22e449-fe66-4591-9008-c39158c400e0 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.238s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-da21ecf9-eab1-4885-85a0-17af039b64b1 req-1c22e449-fe66-4591-9008-c39158c400e0 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-d24f5b2c-ebcf-4cb5-bf49-163309aaa51b req-cb68b9f7-db4a-4cd9-9182-49162434bd6d tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.443s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-11901337-5276-4337-8b79-5020d351eb65 tempest-VolumesActionsTest-505726007 None] Copy volume to image completed successfully. Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-d24f5b2c-ebcf-4cb5-bf49-163309aaa51b req-cb68b9f7-db4a-4cd9-9182-49162434bd6d tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-da21ecf9-eab1-4885-85a0-17af039b64b1 req-1c22e449-fe66-4591-9008-c39158c400e0 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb3e1dce-a412-4c83-bd0a-ca784efc15ab', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:15:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-d24f5b2c-ebcf-4cb5-bf49-163309aaa51b req-cb68b9f7-db4a-4cd9-9182-49162434bd6d tempest-TestServerVolumeAttachmentScenario-612571412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-255ade72-0e92-4f54-9201-4e2ee6cffe72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33fc189f-46cb-4bdb-93d7-2d34cc1a1713', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:15:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-da21ecf9-eab1-4885-85a0-17af039b64b1 req-1c22e449-fe66-4591-9008-c39158c400e0 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] attachment_update completed successfully. Sep 28 15:15:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-d24f5b2c-ebcf-4cb5-bf49-163309aaa51b req-cb68b9f7-db4a-4cd9-9182-49162434bd6d tempest-TestServerVolumeAttachmentScenario-612571412 None] attachment_update completed successfully. Sep 28 15:15:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Acquiring lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Acquiring lock "cinder-quobyte-cbb5023f-b291-4183-8769-d97255760dd5" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Lock "cinder-quobyte-cbb5023f-b291-4183-8769-d97255760dd5" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:07 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c448cd39-e932-480a-874d-181eba18fcbc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:07 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:15:07 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:08 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.579s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:08 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5 Sep 28 15:15:08 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:08 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-cbb5023f-b291-4183-8769-d97255760dd5" returned: 0 in 0.445s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Lock "cinder-quobyte-cbb5023f-b291-4183-8769-d97255760dd5" released by "delete_volume" :: held 1.099s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Created reservations ['f2458f98-b823-4c32-96cd-d8e8a9ce0455', '77767495-f288-4491-86d6-d742bc41a472', '8c9ab7c8-e788-498e-b83e-fb3557be1e52', '511ad713-5211-46ae-93db-c74ffa0eec6f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:08 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:15:08 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:09 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.368s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Deleted volume successfully. Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-685f53a0-d2a2-4e83-adc0-8901393581ee tempest-VolumesActionsTest-505726007 None] Lock "cinder-cbb5023f-b291-4183-8769-d97255760dd5-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-4384f463-e825-41fd-8805-6dd8b58f0ed5 req-f2090288-4f8e-40b0-a51f-130047751647 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Terminate volume connection completed successfully. Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-4384f463-e825-41fd-8805-6dd8b58f0ed5 req-f2090288-4f8e-40b0-a51f-130047751647 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Deleting attachment eb3e1dce-a412-4c83-bd0a-ca784efc15ab. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-f50b1072-2d06-4ed3-909b-67a912afc80f req-b9c1ec0b-403b-4464-bf5e-2a29c64e210b tempest-TestServerVolumeAttachmentScenario-612571412 None] Terminate volume connection completed successfully. Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-f50b1072-2d06-4ed3-909b-67a912afc80f req-b9c1ec0b-403b-4464-bf5e-2a29c64e210b tempest-TestServerVolumeAttachmentScenario-612571412 None] Deleting attachment 33fc189f-46cb-4bdb-93d7-2d34cc1a1713. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Acquiring lock "cinder-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "cinder-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Acquiring lock "cinder-quobyte-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "cinder-quobyte-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f" acquired by "delete_volume" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b5ebb2-a2c1-42b9-8d18-b6013b9592f5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:10 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f Sep 28 15:15:10 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:10 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f" returned: 0 in 0.601s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:10 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f Sep 28 15:15:10 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:11 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f" returned: 0 in 0.529s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "cinder-quobyte-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f" released by "delete_volume" :: held 1.214s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-103a9904-affd-4652-b8cc-6b138681bb9e req-a9a75153-fab4-450a-9204-f5305a0e249f tempest-TestServerVolumeAttachmentScenario-612571412 None] Terminate volume connection completed successfully. Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-103a9904-affd-4652-b8cc-6b138681bb9e req-a9a75153-fab4-450a-9204-f5305a0e249f tempest-TestServerVolumeAttachmentScenario-612571412 None] Deleting attachment fc9c119b-6de4-433c-a5e3-35ae6d03edab. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Created reservations ['d6c3f7ab-e9fd-4f0f-9323-099e467519d5', 'c2bb9c3f-157f-4c11-bc20-408bf89818e2', '28e6ca5d-8435-4107-b2be-3a9e64652fbc', 'f1e14c60-508f-445a-adc7-aa0ef759b1a6'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:11 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:15:11 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:11 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Deleted volume successfully. Sep 28 15:15:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aff75366-a265-440a-9869-5b988215c975 tempest-TestServerVolumeAttachScenarioOldVersion-1945759733 None] Lock "cinder-f47f6c88-9c05-4c0d-af9e-5cc682a23b0f-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:21 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=24,cinder:SELECT=33,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:21 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=37,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "cinder-255ade72-0e92-4f54-9201-4e2ee6cffe72-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-255ade72-0e92-4f54-9201-4e2ee6cffe72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "cinder-quobyte-255ade72-0e92-4f54-9201-4e2ee6cffe72" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-quobyte-255ade72-0e92-4f54-9201-4e2ee6cffe72" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9d74a-9226-41a2-8682-b8a389c4497f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:24 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 Sep 28 15:15:24 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:24 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72" returned: 0 in 0.576s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:24 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72 Sep 28 15:15:24 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:25 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-255ade72-0e92-4f54-9201-4e2ee6cffe72" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-quobyte-255ade72-0e92-4f54-9201-4e2ee6cffe72" released by "delete_volume" :: held 1.089s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Created reservations ['15bcfa01-1191-41c0-b75d-5cab685e9955', '72b54392-1807-42e6-8338-cd170ce367a3', 'e1830c6a-7323-4c97-9c34-cb7904e366ba', '042c727a-3878-4a7f-8250-24939aa32b07'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:25 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:15:25 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:25 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.439s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:25 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Deleted volume successfully. Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-74cda199-4cf8-4bdc-b6be-d4e9988dd742 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-255ade72-0e92-4f54-9201-4e2ee6cffe72-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "cinder-0f36045c-cf88-4a60-854b-362f29e58dae-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-0f36045c-cf88-4a60-854b-362f29e58dae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "cinder-quobyte-0f36045c-cf88-4a60-854b-362f29e58dae" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-quobyte-0f36045c-cf88-4a60-854b-362f29e58dae" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21776b5-c439-4945-ac12-2a388cd149fd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:26 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae Sep 28 15:15:26 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:27 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae" returned: 0 in 0.541s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae Sep 28 15:15:27 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:27 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0f36045c-cf88-4a60-854b-362f29e58dae" returned: 0 in 0.399s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-quobyte-0f36045c-cf88-4a60-854b-362f29e58dae" released by "delete_volume" :: held 1.022s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Created reservations ['4c6d92c6-d46f-49c9-ab9a-0cc82579d304', '91fa6c38-5da4-4f31-a3f2-4192b70670fb', 'def7f477-7204-43fa-a816-8cf4dbdbacc1', '9ca44fc4-1bd8-401d-b801-b8e4bbfb634a'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:15:27 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Deleted volume successfully. Sep 28 15:15:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d3c0a41f-21dd-4bdc-85e6-c251dce4ab58 tempest-TestServerVolumeAttachmentScenario-612571412 None] Lock "cinder-0f36045c-cf88-4a60-854b-362f29e58dae-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Flow 'volume_create_manager' (12b429cb-6944-44b7-ac40-0f79cc10f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90d01a4-feda-4714-920e-24f47a08e092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90d01a4-feda-4714-920e-24f47a08e092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1156095263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f4b05f-99f8-41e4-a3e0-a22414b161bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999301b497a2424ba87ec6107f7cd9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:29Z,use_quota=True,user_id='d89859fc976f40d198c12d867c73d40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7e1ffb-85f6-4bb1-b00e-f80e42c90dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7e1ffb-85f6-4bb1-b00e-f80e42c90dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d09ee0c-2817-4a7c-9b5f-4d4ba560d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d09ee0c-2817-4a7c-9b5f-4d4ba560d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30f4b05f-99f8-41e4-a3e0-a22414b161bc', 'volume_name': 'volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16cd9f5-3f12-4b5c-bcca-4ffe3b968ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16cd9f5-3f12-4b5c-bcca-4ffe3b968ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5fac46-8436-4c2f-b28c-077a8c9c8158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:29 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Volume 30f4b05f-99f8-41e4-a3e0-a22414b161bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:15:29 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Trying to clone 30f4b05f-99f8-41e4-a3e0-a22414b161bc from image c58ceb91-c951-49e6-a030-d9ed772c37aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:15:30 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:15:30 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:15:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88e381-f2de-4d3f-bad8-9915273ba241]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:30 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD Sep 28 15:15:30 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:30 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:30 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa is fetched for user d89859fc976f40d198c12d867c73d40e. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d16d9-279a-481d-9ce5-8e4df2513cf7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:31 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD Sep 28 15:15:31 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:31 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1156095263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f4b05f-99f8-41e4-a3e0-a22414b161bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999301b497a2424ba87ec6107f7cd9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:29Z,use_quota=True,user_id='d89859fc976f40d198c12d867c73d40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Creating volume 30f4b05f-99f8-41e4-a3e0-a22414b161bc {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:31 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:15:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:31 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc 1073741824 Sep 28 15:15:31 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:32 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc 1073741824" returned: 0 in 0.783s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:32 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc Sep 28 15:15:32 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Flow 'volume_create_manager' (b6f8ff2c-d8bc-447d-ae7d-294fc166aedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb8e37a-9aae-4afb-b5d1-faaaf6ef5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb8e37a-9aae-4afb-b5d1-faaaf6ef5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1071712823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ece64bd-3f01-452b-95c8-3de2a8db25b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662c68bbdea441d1ae15d7dd72fa9ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:33Z,use_quota=True,user_id='211d8ee6416c40449d228b37b5fa0fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1823b77d-0fbb-494b-9325-f0ac58b684ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1823b77d-0fbb-494b-9325-f0ac58b684ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c31989b-dbc0-438d-9aa9-a72d0bb4217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c31989b-dbc0-438d-9aa9-a72d0bb4217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ece64bd-3f01-452b-95c8-3de2a8db25b0', 'volume_name': 'volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38ea72d-157c-4636-b13c-5e707b8c6c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38ea72d-157c-4636-b13c-5e707b8c6c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9939f374-9c39-4880-be80-9677a74277c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0', 'volume_size': 1} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:32 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1071712823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ece64bd-3f01-452b-95c8-3de2a8db25b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662c68bbdea441d1ae15d7dd72fa9ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:33Z,use_quota=True,user_id='211d8ee6416c40449d228b37b5fa0fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Creating volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:32 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:32 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 1073741824 Sep 28 15:15:32 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Attempting download of c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 30f4b05f-99f8-41e4-a3e0-a22414b161bc. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe209e-ee51-49d9-bf4b-6c191f697a74]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir Sep 28 15:15:33 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir" returned: 0 in 0.431s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 1073741824" returned: 0 in 0.670s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 Sep 28 15:15:33 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0" returned: 0 in 0.297s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:33 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9939f374-9c39-4880-be80-9677a74277c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f13844-fd4d-4f80-bcf8-7050e2376276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir" returned: 1 in 0.497s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c58ceb91-c951-49e6-a030-d9ed772c37aa_tmzh5yir' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[436585c6-bd13-46d4-ab55-a866c58b77c5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Volume volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 (6ece64bd-3f01-452b-95c8-3de2a8db25b0): created successfully Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f13844-fd4d-4f80-bcf8-7050e2376276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Flow 'volume_create_manager' (b6f8ff2c-d8bc-447d-ae7d-294fc166aedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6c29e8b3-847a-4412-b5c5-c4b30e4ba9a6 tempest-VolumesSnapshotListTestJSON-1859925890 None] Created volume successfully. Sep 28 15:15:34 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD Sep 28 15:15:34 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:34 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:34 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] c58ceb91-c951-49e6-a030-d9ed772c37aa was qcow2, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:15:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:34 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc Sep 28 15:15:34 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Creating offline snapshot 5fa843b5-587f-4626-8fcb-6548c28d05b8 of volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de3a2b5-c6d3-42ec-b0e3-229d30598598]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:35 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 Sep 28 15:15:35 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:35 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0" returned: 0 in 0.602s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:35 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 1G Sep 28 15:15:35 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:36 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 1G" returned: 0 in 0.595s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:36 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:36 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:36 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 0.459s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:36 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 is being set with open permissions: ugo+rw Sep 28 15:15:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:36 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:36 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:37 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 0.365s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:37 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info Sep 28 15:15:37 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:37 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:15:37 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:37 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc" returned: 0 in 3.015s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c58ceb91-c951-49e6-a030-d9ed772c37aa_z4214r4cdevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:37 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Converted 112.00 MB image at 37.12 MB/s Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:37 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc 1G Sep 28 15:15:37 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:37 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info" returned: 0 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:37 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info is being set with open permissions: ugo+rw Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:37 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info Sep 28 15:15:37 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:37 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.461s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:15:37 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc 1G" returned: 0 in 0.537s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Downloaded image c58ceb91-c951-49e6-a030-d9ed772c37aa ((None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}])) to volume 30f4b05f-99f8-41e4-a3e0-a22414b161bc successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:15:37 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Temporary image c58ceb91-c951-49e6-a030-d9ed772c37aa for user d89859fc976f40d198c12d867c73d40e is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Marking volume 30f4b05f-99f8-41e4-a3e0-a22414b161bc as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:15:38 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Copying metadata from image c58ceb91-c951-49e6-a030-d9ed772c37aa to 30f4b05f-99f8-41e4-a3e0-a22414b161bc. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Creating volume glance metadata for volume 30f4b05f-99f8-41e4-a3e0-a22414b161bc backed by image c58ceb91-c951-49e6-a030-d9ed772c37aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.info" returned: 0 in 0.414s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8e324215-814f-4617-baac-06726cb716af tempest-VolumesSnapshotListTestJSON-1859925890 None] Create snapshot completed successfully Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5fac46-8436-4c2f-b28c-077a8c9c8158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc', 'volume_size': 1, 'image_id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c58ceb91-c951-49e6-a030-d9ed772c37aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '134be97b3a71446c894d655a3e1ce5cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c58ceb91-c951-49e6-a030-d9ed772c37aa', 'created_at': datetime.datetime(2026, 9, 28, 12, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c58ceb91-c951-49e6-a030-d9ed772c37aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3704beb-c733-4d69-b498-ebb82fce329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:38 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Volume volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc (30f4b05f-99f8-41e4-a3e0-a22414b161bc): created successfully Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3704beb-c733-4d69-b498-ebb82fce329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Flow 'volume_create_manager' (12b429cb-6944-44b7-ac40-0f79cc10f3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a0574a73-98f5-4ca8-9441-30195cf2453d tempest-TestShelveInstance-1913037702 None] Created volume successfully. Sep 28 15:15:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Creating offline snapshot 3a9b05a8-8375-4401-94b2-a1d236e3af92 of volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74d274-bcce-4f73-97dc-0d8ffd52f049]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:39 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:39 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:40 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:40 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 1G Sep 28 15:15:40 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:40 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 1G" returned: 0 in 0.662s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:40 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:40 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:41 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.411s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:41 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 is being set with open permissions: ugo+rw Sep 28 15:15:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:41 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:41 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.355s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:41 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:41 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e6880079-ec56-4d29-8969-b6401b9db905 tempest-VolumesSnapshotListTestJSON-1859925890 None] Create snapshot completed successfully Sep 28 15:15:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Creating offline snapshot 76caa845-4d39-4b3a-8a42-c7c5a2222e38 of volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:43 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f2590-1617-4f1d-861e-f759589f901b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:43 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:43 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:44 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.703s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:44 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 1G Sep 28 15:15:44 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-e2dc941a-0dc8-40bf-9e6e-f2096b81e183 req-ac7e5885-9150-4aec-a640-d2269b4411ff tempest-TestShelveInstance-1913037702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:44 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 1G" returned: 0 in 0.817s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:44 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 Sep 28 15:15:44 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:45 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38" returned: 0 in 0.369s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:45 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 is being set with open permissions: ugo+rw Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:45 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 Sep 28 15:15:45 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:45 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38" returned: 0 in 0.388s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-e2dc941a-0dc8-40bf-9e6e-f2096b81e183 req-ac7e5885-9150-4aec-a640-d2269b4411ff tempest-TestShelveInstance-1913037702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.341s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-e2dc941a-0dc8-40bf-9e6e-f2096b81e183 req-ac7e5885-9150-4aec-a640-d2269b4411ff tempest-TestShelveInstance-1913037702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e2185435-7477-435f-aeec-3dd26e236e63 tempest-VolumesSnapshotListTestJSON-1859925890 None] Create snapshot completed successfully Sep 28 15:15:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-e2dc941a-0dc8-40bf-9e6e-f2096b81e183 req-ac7e5885-9150-4aec-a640-d2269b4411ff tempest-TestShelveInstance-1913037702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e09830bc-16db-4909-910c-f3c42d2c8f21', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:15:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-e2dc941a-0dc8-40bf-9e6e-f2096b81e183 req-ac7e5885-9150-4aec-a640-d2269b4411ff tempest-TestShelveInstance-1913037702 None] attachment_update completed successfully. Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-76caa845-4d39-4b3a-8a42-c7c5a2222e38-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-76caa845-4d39-4b3a-8a42-c7c5a2222e38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-76caa845-4d39-4b3a-8a42-c7c5a2222e38" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-76caa845-4d39-4b3a-8a42-c7c5a2222e38" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Deleting offline snapshot 76caa845-4d39-4b3a-8a42-c7c5a2222e38 of volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] snapshot_file for this snap is: volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b698c1-ef5b-418f-9786-c9d523994188]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:48 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 Sep 28 15:15:48 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:48 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38" returned: 0 in 0.791s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ee494e-bbc5-48c1-9004-097d72d175da]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:49 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:49 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:49 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.747s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:49 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 Sep 28 15:15:49 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (c9e0381c-cc98-4964-93fa-f403a1648a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0e0a86-7223-466f-8e6d-a0ab5226998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0e0a86-7223-466f-8e6d-a0ab5226998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023069883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581cfe05-0a2c-4f61-ae13-0dc0c4b60653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:50Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5522d0-38b9-4d15-ab74-6c7d214be506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5522d0-38b9-4d15-ab74-6c7d214be506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a425e-ce25-49e1-a50e-745ef79ee5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a425e-ce25-49e1-a50e-745ef79ee5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '581cfe05-0a2c-4f61-ae13-0dc0c4b60653', 'volume_name': 'volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a9b76-db21-4178-b225-5b8c9c173d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a9b76-db21-4178-b225-5b8c9c173d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b16e672-e192-40fa-bbd2-76f9965a6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume 581cfe05-0a2c-4f61-ae13-0dc0c4b60653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653', 'volume_size': 1} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023069883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581cfe05-0a2c-4f61-ae13-0dc0c4b60653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:50Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating volume 581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:50 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:50 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 1073741824 Sep 28 15:15:50 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:50 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38" returned: 0 in 0.931s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:50 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38 Sep 28 15:15:50 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:51 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 1073741824" returned: 0 in 0.961s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:51 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.76caa845-4d39-4b3a-8a42-c7c5a2222e38" returned: 0 in 0.731s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-76caa845-4d39-4b3a-8a42-c7c5a2222e38" released by "_delete_snapshot" :: held 3.431s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" released by "delete_snapshot" :: held 3.482s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:51 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 Sep 28 15:15:51 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Created reservations ['7cb06d11-fe96-4dd8-a8d2-7650ccc4ebbe', '1a55f122-ab2e-4ec0-a6ad-98a1056c267f', '1e7eede8-894b-41a7-b10b-4344162fab37', '82c087b1-5249-44a1-969d-1fdce9077ca2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Delete snapshot completed successfully. Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-582621a7-d784-455e-a379-fb0966a509c4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-76caa845-4d39-4b3a-8a42-c7c5a2222e38-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:51 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" returned: 0 in 0.635s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b16e672-e192-40fa-bbd2-76f9965a6033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fe2495-ba61-43b4-a223-cde5e10cc791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 (581cfe05-0a2c-4f61-ae13-0dc0c4b60653): created successfully Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fe2495-ba61-43b4-a223-cde5e10cc791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (c9e0381c-cc98-4964-93fa-f403a1648a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bd6c7048-e8bb-4aee-a107-bb868230a38d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created volume successfully. Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-3a9b05a8-8375-4401-94b2-a1d236e3af92-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-3a9b05a8-8375-4401-94b2-a1d236e3af92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-3a9b05a8-8375-4401-94b2-a1d236e3af92" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-3a9b05a8-8375-4401-94b2-a1d236e3af92" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Deleting offline snapshot 3a9b05a8-8375-4401-94b2-a1d236e3af92 of volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] snapshot_file for this snap is: volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a05a48d-9392-4e45-a1d1-f0f86e17f3b6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:52 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:52 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:52 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.493s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[54409b33-26a3-4a3b-94fd-42c869c41dcd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:53 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 0.713s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:53 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating offline snapshot 236e061c-059a-4328-82dd-52bb561bd81a of volume 581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4c2130-6f78-45c6-a85c-a3a6dfd5138a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 Sep 28 15:15:54 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:54 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.888s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" returned: 0 in 0.680s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92 Sep 28 15:15:54 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:54 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a 1G Sep 28 15:15:54 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:55 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.3a9b05a8-8375-4401-94b2-a1d236e3af92" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-3a9b05a8-8375-4401-94b2-a1d236e3af92" released by "_delete_snapshot" :: held 2.995s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" released by "delete_snapshot" :: held 3.037s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Created reservations ['069fb961-3058-4973-9959-3d8be7c5bebd', '787bc95f-3948-42ba-be4f-ee93ddfdd1eb', '3fca88af-076f-4df5-8645-7c1aa081161b', 'cf27fda5-6f97-4727-a88c-8883470cd46c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Delete snapshot completed successfully. Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c5fd237-fc2e-41bf-9628-e83e55faa35a tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-3a9b05a8-8375-4401-94b2-a1d236e3af92-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:55 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a 1G" returned: 0 in 1.170s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:55 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a Sep 28 15:15:55 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a" returned: 0 in 0.494s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a is being set with open permissions: ugo+rw Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a Sep 28 15:15:56 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-5fa843b5-587f-4626-8fcb-6548c28d05b8-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a" returned: 0 in 0.483s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-5fa843b5-587f-4626-8fcb-6548c28d05b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-5fa843b5-587f-4626-8fcb-6548c28d05b8" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-5fa843b5-587f-4626-8fcb-6548c28d05b8" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Deleting offline snapshot 5fa843b5-587f-4626-8fcb-6548c28d05b8 of volume 6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:15:56 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info Sep 28 15:15:56 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] snapshot_file for this snap is: volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:15:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e66e114-03c5-47af-982a-e400afb96c9e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:57 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info" returned: 0 in 0.657s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:57 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info is being set with open permissions: ugo+rw Sep 28 15:15:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info Sep 28 15:15:57 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:58 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.info" returned: 0 in 0.566s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:58 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 1.158s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ed137-064e-4ebe-bbd8-4fcc097a2dfc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f7662abf-1241-4ab2-82bd-2069bedd057d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Create snapshot completed successfully Sep 28 15:15:58 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 Sep 28 15:15:58 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0" returned: 0 in 0.870s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:59 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 0.752s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8 Sep 28 15:15:59 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0.5fa843b5-587f-4626-8fcb-6548c28d05b8" returned: 0 in 0.704s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-5fa843b5-587f-4626-8fcb-6548c28d05b8" released by "_delete_snapshot" :: held 3.795s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" released by "delete_snapshot" :: held 3.867s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:00 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Created reservations ['0d51fb71-5a5a-454f-887a-e125d4317784', 'f8116eae-b127-429f-b616-a84446b950f6', 'd02ce923-dc64-44f1-88f7-0dce3928da2f', 'e87f1339-db1c-421f-99f4-b912cd712a41'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (d402816a-ecda-426d-95b5-0032b7061e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c67caa-dedd-4e2b-bb4a-311a6250352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c67caa-dedd-4e2b-bb4a-311a6250352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503812518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23739bbf-0362-4c07-b455-b222bb9390fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:01Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3195b0b-12a2-4222-9abd-e472deaca24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3195b0b-12a2-4222-9abd-e472deaca24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb01b01-d4e2-4026-9d78-7eb34d200ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb01b01-d4e2-4026-9d78-7eb34d200ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23739bbf-0362-4c07-b455-b222bb9390fd', 'volume_name': 'volume-23739bbf-0362-4c07-b455-b222bb9390fd', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86e2338-3547-4210-9397-ee270b2eaafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86e2338-3547-4210-9397-ee270b2eaafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be07438-1d7b-42e9-b18b-0937a0e99262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume 23739bbf-0362-4c07-b455-b222bb9390fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23739bbf-0362-4c07-b455-b222bb9390fd', 'volume_size': 1} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503812518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23739bbf-0362-4c07-b455-b222bb9390fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:01Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating volume 23739bbf-0362-4c07-b455-b222bb9390fd {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:01 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd 1073741824 Sep 28 15:16:01 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Delete snapshot completed successfully. Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b3698e06-caa2-41cf-9f81-929ae4e712a4 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-5fa843b5-587f-4626-8fcb-6548c28d05b8-delete_snapshot" released by "delete_snapshot" :: held 4.844s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-6ece64bd-3f01-452b-95c8-3de2a8db25b0-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-6ece64bd-3f01-452b-95c8-3de2a8db25b0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" acquired by "delete_volume" :: waited 0.089s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed826d66-04f5-41bf-a437-64a483483522]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (dea86883-0d83-4cf6-a9d0-a57a81e6de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73f1704-7873-4e3d-a513-be16739fc742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73f1704-7873-4e3d-a513-be16739fc742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140783278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4327f0cc-213d-4218-a827-cb5eede3d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:02Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d91b4d-220f-4225-a983-5bbe28f6983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d91b4d-220f-4225-a983-5bbe28f6983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f53a37-39aa-4cb3-b8bd-5fcce5d0d60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f53a37-39aa-4cb3-b8bd-5fcce5d0d60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4327f0cc-213d-4218-a827-cb5eede3d16d', 'volume_name': 'volume-4327f0cc-213d-4218-a827-cb5eede3d16d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9d3339-f3dd-40c8-b722-79b8a4a2b688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9d3339-f3dd-40c8-b722-79b8a4a2b688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 Sep 28 15:16:02 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda22e37-7c85-4343-885b-890ec9731868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume 4327f0cc-213d-4218-a827-cb5eede3d16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4327f0cc-213d-4218-a827-cb5eede3d16d', 'volume_size': 1} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:02 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd 1073741824" returned: 0 in 1.216s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd Sep 28 15:16:02 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0" returned: 0 in 0.858s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0 Sep 28 15:16:03 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd" returned: 0 in 0.514s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140783278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4327f0cc-213d-4218-a827-cb5eede3d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:02Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating volume 4327f0cc-213d-4218-a827-cb5eede3d16d {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:03 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d 1073741824 Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be07438-1d7b-42e9-b18b-0937a0e99262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23739bbf-0362-4c07-b455-b222bb9390fd', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:03 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c679a58a-790a-427c-88b0-a66ceabe24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:03 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume volume-23739bbf-0362-4c07-b455-b222bb9390fd (23739bbf-0362-4c07-b455-b222bb9390fd): created successfully Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c679a58a-790a-427c-88b0-a66ceabe24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (d402816a-ecda-426d-95b5-0032b7061e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5e0b494d-4118-4c24-bd14-c0e00781df98 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created volume successfully. Sep 28 15:16:03 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6ece64bd-3f01-452b-95c8-3de2a8db25b0" returned: 0 in 0.630s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-quobyte-6ece64bd-3f01-452b-95c8-3de2a8db25b0" released by "delete_volume" :: held 1.669s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:03 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Created reservations ['db32fee8-8f63-44b2-a6cf-6fec57121db8', 'f1bf6231-3bbe-41ba-a297-a15051302b0e', '6bc8d5bc-f5fe-4652-8c22-8ca2190b75b2', 'a455257a-5957-41f0-b6dc-1663b9abe12c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (fc7047ff-ecd0-4e92-9aad-e23a26329c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f29ff97-6b31-4210-8b67-dba22d71089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f29ff97-6b31-4210-8b67-dba22d71089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324151996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af31c5e7-bccd-4c91-b2db-78d7b9830128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:04Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634bcee7-9acc-4209-be86-3cff20f63afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634bcee7-9acc-4209-be86-3cff20f63afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c2d738-ab4c-43cd-b09e-20779053d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c2d738-ab4c-43cd-b09e-20779053d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af31c5e7-bccd-4c91-b2db-78d7b9830128', 'volume_name': 'volume-af31c5e7-bccd-4c91-b2db-78d7b9830128', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7df6bf7-b410-44b1-936d-df5cfbb258cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7df6bf7-b410-44b1-936d-df5cfbb258cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a8c575-b79e-4405-a278-fb8401ccb06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:04 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume af31c5e7-bccd-4c91-b2db-78d7b9830128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af31c5e7-bccd-4c91-b2db-78d7b9830128', 'volume_size': 1} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:04 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:04 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d 1073741824" returned: 0 in 1.586s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (0c2ec801-6529-4805-81bf-e73157ccf8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d686955c-334c-4999-9efe-440f9e721754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.756s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d686955c-334c-4999-9efe-440f9e721754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948546966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa1c262-4b06-4a5f-a633-847a9003f290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:05Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9497f29-951f-4e22-b31e-39ae10b0c37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9497f29-951f-4e22-b31e-39ae10b0c37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d8e290-c97b-4d83-8887-a445c0924218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d8e290-c97b-4d83-8887-a445c0924218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa1c262-4b06-4a5f-a633-847a9003f290', 'volume_name': 'volume-3aa1c262-4b06-4a5f-a633-847a9003f290', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c2e03f-9450-4341-80e5-2bc81a7c1fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c2e03f-9450-4341-80e5-2bc81a7c1fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbdbeeb-24c9-4409-854c-1e6893b53521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume 3aa1c262-4b06-4a5f-a633-847a9003f290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa1c262-4b06-4a5f-a633-847a9003f290', 'volume_size': 1} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Deleted volume successfully. Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ced775a0-9e21-43cc-a73b-f72ecf4be846 tempest-VolumesSnapshotListTestJSON-1859925890 None] Lock "cinder-6ece64bd-3f01-452b-95c8-3de2a8db25b0-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:05 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (6966eec0-a1a0-4711-9500-d60ed91bea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd63a3-ecb3-4c21-8238-c4a8dc4ddeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd63a3-ecb3-4c21-8238-c4a8dc4ddeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-150749890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf88afe-6d24-433c-a871-1b0c06b15f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:06Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171da94c-52e9-48f9-afe2-4b8ff73195f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171da94c-52e9-48f9-afe2-4b8ff73195f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06570c33-c712-4fed-acb3-12fc02648564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06570c33-c712-4fed-acb3-12fc02648564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf88afe-6d24-433c-a871-1b0c06b15f83', 'volume_name': 'volume-9bf88afe-6d24-433c-a871-1b0c06b15f83', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee99fb5-f36f-41b0-91c4-5a6287578d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee99fb5-f36f-41b0-91c4-5a6287578d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db26097c-ab37-4c38-b90e-96f094bb1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume 9bf88afe-6d24-433c-a871-1b0c06b15f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf88afe-6d24-433c-a871-1b0c06b15f83', 'volume_size': 1} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:06 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d" returned: 0 in 0.673s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] <== create_volume: return (2648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.657s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324151996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af31c5e7-bccd-4c91-b2db-78d7b9830128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:04Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating volume af31c5e7-bccd-4c91-b2db-78d7b9830128 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:06 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:06 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 1073741824 Sep 28 15:16:06 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda22e37-7c85-4343-885b-890ec9731868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4327f0cc-213d-4218-a827-cb5eede3d16d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2260408-caed-4e40-8e09-9d4f8bcbd26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume volume-4327f0cc-213d-4218-a827-cb5eede3d16d (4327f0cc-213d-4218-a827-cb5eede3d16d): created successfully Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2260408-caed-4e40-8e09-9d4f8bcbd26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (dea86883-0d83-4cf6-a9d0-a57a81e6de11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1db6260e-59a2-43a1-8302-e952a28fb035 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created volume successfully. Sep 28 15:16:07 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 1073741824" returned: 0 in 0.914s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:07 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 Sep 28 15:16:07 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:07 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128" returned: 0 in 0.442s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.206s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948546966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa1c262-4b06-4a5f-a633-847a9003f290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:05Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating volume 3aa1c262-4b06-4a5f-a633-847a9003f290 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:07 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:07 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 1073741824 Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a8c575-b79e-4405-a278-fb8401ccb06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af31c5e7-bccd-4c91-b2db-78d7b9830128', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:07 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cc4724-c274-43e5-b36c-d8b18dacd457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 (af31c5e7-bccd-4c91-b2db-78d7b9830128): created successfully Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cc4724-c274-43e5-b36c-d8b18dacd457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (fc7047ff-ecd0-4e92-9aad-e23a26329c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5636362a-474f-4c03-8afe-0f19b052568d tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created volume successfully. Sep 28 15:16:08 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 1073741824" returned: 0 in 0.828s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 Sep 28 15:16:08 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:08 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290" returned: 0 in 0.489s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.924s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-150749890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf88afe-6d24-433c-a871-1b0c06b15f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae8cb080ad442e3b4e249f173f6bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:06Z,use_quota=True,user_id='6b852a48407641e0840ed7443125f952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Creating volume 9bf88afe-6d24-433c-a871-1b0c06b15f83 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:08 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbdbeeb-24c9-4409-854c-1e6893b53521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa1c262-4b06-4a5f-a633-847a9003f290', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7bf0e7-7440-4c8b-9629-1f469d34695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:09 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 1073741824 Sep 28 15:16:09 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume volume-3aa1c262-4b06-4a5f-a633-847a9003f290 (3aa1c262-4b06-4a5f-a633-847a9003f290): created successfully Sep 28 15:16:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7bf0e7-7440-4c8b-9629-1f469d34695a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (0c2ec801-6529-4805-81bf-e73157ccf8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-48411974-52bd-4104-889a-ec9eed1250af tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created volume successfully. Sep 28 15:16:10 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 1073741824" returned: 0 in 1.082s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:10 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 Sep 28 15:16:10 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:10 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83" returned: 0 in 0.481s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db26097c-ab37-4c38-b90e-96f094bb1b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf88afe-6d24-433c-a871-1b0c06b15f83', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce8d9c7-41d5-4628-8068-23b5318bef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Volume volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 (9bf88afe-6d24-433c-a871-1b0c06b15f83): created successfully Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce8d9c7-41d5-4628-8068-23b5318bef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Flow 'volume_create_manager' (6966eec0-a1a0-4711-9500-d60ed91bea1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-20f3caff-a66b-4806-bdbf-e9e15c6874b9 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created volume successfully. Sep 28 15:16:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-9bf88afe-6d24-433c-a871-1b0c06b15f83-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-9bf88afe-6d24-433c-a871-1b0c06b15f83-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-9bf88afe-6d24-433c-a871-1b0c06b15f83" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-9bf88afe-6d24-433c-a871-1b0c06b15f83" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:12 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fc55e-ab4f-42eb-852e-07f71fdfe978]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 Sep 28 15:16:12 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83" returned: 0 in 0.544s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83 Sep 28 15:16:12 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9bf88afe-6d24-433c-a871-1b0c06b15f83" returned: 0 in 0.554s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-9bf88afe-6d24-433c-a871-1b0c06b15f83" released by "delete_volume" :: held 1.202s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['c9e8f6d8-9294-436a-ab39-15da6ec98517', 'aa48aa9d-b19a-42e9-a10d-f741d5656979', '5e8e74c5-17a0-45e2-bf79-5d7b629308a1', 'df36c93a-1003-49d7-877d-6cc71ec4502d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:13 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:13 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.400s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleted volume successfully. Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9daf22d0-0730-4976-99ab-50654b8c2def tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-9bf88afe-6d24-433c-a871-1b0c06b15f83-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-3aa1c262-4b06-4a5f-a633-847a9003f290-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-3aa1c262-4b06-4a5f-a633-847a9003f290-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-3aa1c262-4b06-4a5f-a633-847a9003f290" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-3aa1c262-4b06-4a5f-a633-847a9003f290" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aad04d-522f-430e-86c2-eadd1482d3b9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:14 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 Sep 28 15:16:14 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290" returned: 0 in 0.646s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290 Sep 28 15:16:15 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3aa1c262-4b06-4a5f-a633-847a9003f290" returned: 0 in 0.385s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-3aa1c262-4b06-4a5f-a633-847a9003f290" released by "delete_volume" :: held 1.128s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:15 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['27ea4d97-28df-46dd-8cd3-b9e35db7d9d8', 'c8579bbc-9969-4193-a42a-9f8bd6176e53', '61e9cef9-2e30-4d4c-aca5-d6233dd34e56', '543d06f7-ac3e-49b0-ae2f-e3d0ef57c333'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:16 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:16 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:16 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.336s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleted volume successfully. Sep 28 15:16:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9533da72-6880-4e6e-95bc-548603fa7414 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-3aa1c262-4b06-4a5f-a633-847a9003f290-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-af31c5e7-bccd-4c91-b2db-78d7b9830128-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-af31c5e7-bccd-4c91-b2db-78d7b9830128-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-af31c5e7-bccd-4c91-b2db-78d7b9830128" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-af31c5e7-bccd-4c91-b2db-78d7b9830128" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[869b1b5a-2828-4a9d-b23e-bc2901e85e2d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:17 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 Sep 28 15:16:17 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:17 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128" returned: 0 in 0.578s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:17 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128 Sep 28 15:16:17 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Flow 'volume_create_manager' (77addcbd-c4ad-4b92-ab77-55f94fd8c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39f83db-5ad2-46b7-8530-2e003c0901d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39f83db-5ad2-46b7-8530-2e003c0901d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0fa7b-d521-400b-ae63-715aa5bf3f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea1cfedb2f94a4f8f481c9946ee7333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:18Z,use_quota=True,user_id='79baf62595d14096b64cbffb38948a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848ce42-8d1f-422d-9679-fe2fd91dbc03),volume_type_id=9848ce42-8d1f-422d-9679-fe2fd91dbc03)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b982d9ae-aa0e-4a36-9c3a-98affa67030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b982d9ae-aa0e-4a36-9c3a-98affa67030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3465ce7-3e74-45a8-959a-7a789b52bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:16:18 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af31c5e7-bccd-4c91-b2db-78d7b9830128" returned: 0 in 0.305s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-af31c5e7-bccd-4c91-b2db-78d7b9830128" released by "delete_volume" :: held 0.964s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['73cc0216-9287-49ce-8cc6-4779c8f4c62c', '8edeab49-2f72-43fe-a31a-aa21b5662d1d', '5abdb8b7-4b3e-4049-a77f-eeb860f22115', '61dd133d-8461-41f8-873e-8c98a3f83a59'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:18 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3465ce7-3e74-45a8-959a-7a789b52bb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdc0fa7b-d521-400b-ae63-715aa5bf3f9a', 'volume_name': 'volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a', 'volume_size': 1, 'image_id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf6db0b62f2ade8de4f95613beb59ad9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dea1cfedb2f94a4f8f481c9946ee7333', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16678390bb925079a67ab3059c3297f40c9c4a4e277a86399b5a5efdf104702ed48e5e32f61a548b8434752758e2411bb48669d0743e6046c15173c317e9af22', 'id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'created_at': datetime.datetime(2026, 9, 28, 13, 16, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 16, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9d9ea-c9b8-4f4f-9fb2-485d13f6f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9d9ea-c9b8-4f4f-9fb2-485d13f6f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382ddcc9-4337-4152-b0ce-be3a578434b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Volume fdc0fa7b-d521-400b-ae63-715aa5bf3f9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a', 'volume_size': 1, 'image_id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf6db0b62f2ade8de4f95613beb59ad9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dea1cfedb2f94a4f8f481c9946ee7333', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16678390bb925079a67ab3059c3297f40c9c4a4e277a86399b5a5efdf104702ed48e5e32f61a548b8434752758e2411bb48669d0743e6046c15173c317e9af22', 'id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'created_at': datetime.datetime(2026, 9, 28, 13, 16, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 16, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Trying to clone fdc0fa7b-d521-400b-ae63-715aa5bf3f9a from image 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:16:18 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c6c1b-547c-4fa3-8e4a-d39ce9b732c1]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleted volume successfully. Sep 28 15:16:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0791461c-7ff6-4a88-b2e4-5b8abacc8c6f tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-af31c5e7-bccd-4c91-b2db-78d7b9830128-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:18 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD Sep 28 15:16:18 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD Sep 28 15:16:19 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-4327f0cc-213d-4218-a827-cb5eede3d16d-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-4327f0cc-213d-4218-a827-cb5eede3d16d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-4327f0cc-213d-4218-a827-cb5eede3d16d" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-4327f0cc-213d-4218-a827-cb5eede3d16d" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c882e9-a75c-4ac3-929a-6761de4a980c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Temporary image 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 is fetched for user 79baf62595d14096b64cbffb38948a96. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b9c375-df67-4179-b2d6-6099fdf894ad]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d Sep 28 15:16:19 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD Sep 28 15:16:19 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d" returned: 0 in 0.462s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d Sep 28 15:16:20 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD Sep 28 15:16:20 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4327f0cc-213d-4218-a827-cb5eede3d16d" returned: 0 in 0.316s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-4327f0cc-213d-4218-a827-cb5eede3d16d" released by "delete_volume" :: held 0.834s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['951735a5-e940-4e69-9d16-1d14b37ade42', '31ae1561-e281-4ca6-9bf2-3c7d3758ed11', '217706e8-f142-469c-bdef-f532fc7e181b', '25b7ca88-db5a-4f4a-98cc-ceaaeb5b2162'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:20 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0fa7b-d521-400b-ae63-715aa5bf3f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea1cfedb2f94a4f8f481c9946ee7333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:18Z,use_quota=True,user_id='79baf62595d14096b64cbffb38948a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848ce42-8d1f-422d-9679-fe2fd91dbc03),volume_type_id=9848ce42-8d1f-422d-9679-fe2fd91dbc03)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Creating volume fdc0fa7b-d521-400b-ae63-715aa5bf3f9a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:20 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a 1073741824 Sep 28 15:16:20 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-23739bbf-0362-4c07-b455-b222bb9390fd-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-23739bbf-0362-4c07-b455-b222bb9390fd-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-23739bbf-0362-4c07-b455-b222bb9390fd" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-23739bbf-0362-4c07-b455-b222bb9390fd" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:20 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330b350-1ad0-4cf7-9136-e4d298cbad39]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.362s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleted volume successfully. Sep 28 15:16:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-30ed7a98-6935-4cad-a834-f4d2ca2d9075 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-4327f0cc-213d-4218-a827-cb5eede3d16d-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:21 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd Sep 28 15:16:21 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a 1073741824" returned: 0 in 0.669s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a Sep 28 15:16:21 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd" returned: 0 in 0.519s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd Sep 28 15:16:21 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" returned: 0 in 0.306s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=113,cinder:SELECT=88,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Attempting download of 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'metadata': {}}])) to volume fdc0fa7b-d521-400b-ae63-715aa5bf3f9a. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:16:21 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-23739bbf-0362-4c07-b455-b222bb9390fd" returned: 0 in 0.339s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d196b1c-db1c-4486-8f8d-76ad9f6a2b26]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-23739bbf-0362-4c07-b455-b222bb9390fd" released by "delete_volume" :: held 0.946s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['ed2990df-5137-4e39-8085-c9b1563dc557', '41c0bbb7-d94f-444d-a19f-9583e6a8aa9d', 'a7accf7a-4c76-42be-bea9-f05c02c5810f', '1a3fd088-fecb-433e-9a08-5f946f5ee616'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:21 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1 Sep 28 15:16:21 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=107,cinder:INSERT=39,cinder:UPDATE=104,cinder:DELETE=9 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:22 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:22 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1" returned: 0 in 0.534s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.297s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:22 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleted volume successfully. Sep 28 15:16:22 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1 Sep 28 15:16:22 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7aa1fa43-2813-4251-b4c3-028fd3536718 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-23739bbf-0362-4c07-b455-b222bb9390fd-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:22 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1" returned: 1 in 0.405s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_g16no5i1' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f545621-050b-47c3-99a9-a6431bc1ecc0]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD Sep 28 15:16:22 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-236e061c-059a-4328-82dd-52bb561bd81a-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:23 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-236e061c-059a-4328-82dd-52bb561bd81a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-236e061c-059a-4328-82dd-52bb561bd81a" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-236e061c-059a-4328-82dd-52bb561bd81a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleting offline snapshot 236e061c-059a-4328-82dd-52bb561bd81a of volume 581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] snapshot_file for this snap is: volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab9724-703a-4f7c-a543-3375494c4467]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD Sep 28 15:16:23 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a Sep 28 15:16:23 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD" returned: 1 in 0.465s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 was raw, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a Sep 28 15:16:23 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Flow 'volume_create_manager' (4d93c5ef-3728-4d2a-a7fb-4b8a6ccb2683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a53e1a8-dddc-4e24-b091-55a2e2359b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a53e1a8-dddc-4e24-b091-55a2e2359b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2094210544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fac5da6-4271-4641-906a-f9c380c2fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec238bb6ad394b519aa560f5988846ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:24Z,use_quota=True,user_id='8879228ce9814a4e9385b8f14ec42dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae76fab-bb05-4011-97c2-fb80ccbf768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae76fab-bb05-4011-97c2-fb80ccbf768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc947c1-c4ae-4f51-89fa-5bec0c6d401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc947c1-c4ae-4f51-89fa-5bec0c6d401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fac5da6-4271-4641-906a-f9c380c2fa29', 'volume_name': 'volume-9fac5da6-4271-4641-906a-f9c380c2fa29', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af38d51d-7e8c-4b49-b857-4ab131515326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af38d51d-7e8c-4b49-b857-4ab131515326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348f3fdb-fe82-4e9e-83be-fac64ec0930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Volume 9fac5da6-4271-4641-906a-f9c380c2fa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fac5da6-4271-4641-906a-f9c380c2fa29', 'volume_size': 1} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2094210544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fac5da6-4271-4641-906a-f9c380c2fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec238bb6ad394b519aa560f5988846ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:24Z,use_quota=True,user_id='8879228ce9814a4e9385b8f14ec42dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Creating volume 9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:23 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a" returned: 0 in 0.629s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:23 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 1073741824 Sep 28 15:16:23 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cce9613-3ba9-4621-8801-18437803c6f6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 Sep 28 15:16:24 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" returned: 0 in 0.745s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4_uadng0sedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:24 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a 1G Sep 28 15:16:24 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 1073741824" returned: 0 in 0.657s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" returned: 0 in 0.609s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 Sep 28 15:16:24 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29" returned: 0 in 0.293s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348f3fdb-fe82-4e9e-83be-fac64ec0930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fac5da6-4271-4641-906a-f9c380c2fa29', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:24 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ced98c3-5e3d-4869-8b7a-1fc56b36316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a 1G" returned: 0 in 0.580s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Downloaded image 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'metadata': {}}])) to volume fdc0fa7b-d521-400b-ae63-715aa5bf3f9a successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Temporary image 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 for user 79baf62595d14096b64cbffb38948a96 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Marking volume fdc0fa7b-d521-400b-ae63-715aa5bf3f9a as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:16:24 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Volume volume-9fac5da6-4271-4641-906a-f9c380c2fa29 (9fac5da6-4271-4641-906a-f9c380c2fa29): created successfully Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ced98c3-5e3d-4869-8b7a-1fc56b36316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Flow 'volume_create_manager' (4d93c5ef-3728-4d2a-a7fb-4b8a6ccb2683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Copying metadata from image 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 to fdc0fa7b-d521-400b-ae63-715aa5bf3f9a. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:16:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Creating volume glance metadata for volume fdc0fa7b-d521-400b-ae63-715aa5bf3f9a backed by image 1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bf6db0b62f2ade8de4f95613beb59ad9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:16:24 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ed267708-0b8f-4b28-90e8-3ab054399822 tempest-TestImageHashVerification-1086954639 None] Created volume successfully. Sep 28 15:16:25 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a" returned: 0 in 0.520s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382ddcc9-4337-4152-b0ce-be3a578434b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a', 'volume_size': 1, 'image_id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf6db0b62f2ade8de4f95613beb59ad9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dea1cfedb2f94a4f8f481c9946ee7333', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16678390bb925079a67ab3059c3297f40c9c4a4e277a86399b5a5efdf104702ed48e5e32f61a548b8434752758e2411bb48669d0743e6046c15173c317e9af22', 'id': '1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4', 'created_at': datetime.datetime(2026, 9, 28, 13, 16, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 16, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b6ce8f5-923b-4c1b-a545-f0d5224b1fd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:25 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a Sep 28 15:16:25 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f17ef0-deca-4d9f-b171-fe75a5bba3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:25 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Volume volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a (fdc0fa7b-d521-400b-ae63-715aa5bf3f9a): created successfully Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f17ef0-deca-4d9f-b171-fe75a5bba3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Flow 'volume_create_manager' (77addcbd-c4ad-4b92-ab77-55f94fd8c48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a84e2a79-37c0-4589-b0a3-493f1d74276f tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Created volume successfully. Sep 28 15:16:25 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653.236e061c-059a-4328-82dd-52bb561bd81a" returned: 0 in 0.323s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-236e061c-059a-4328-82dd-52bb561bd81a" released by "_delete_snapshot" :: held 2.264s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" released by "delete_snapshot" :: held 2.301s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['621ea649-cb25-4761-99c9-ae15ac13dc3f', '426973d2-74ae-4bdb-bd04-4e206bbe86e5', 'fb9a9d1c-66b4-4346-a710-c12b3884b0ab', 'afe033ed-97fe-48fd-9c51-64a026caf065'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Acquiring lock "cinder-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "cinder-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Delete snapshot completed successfully. Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-874fa0b1-ece6-4ebe-bcc1-5dce4d8b0489 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-236e061c-059a-4328-82dd-52bb561bd81a-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Acquiring lock "cinder-quobyte-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "cinder-quobyte-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae411a2-104b-4fb1-994a-ffd0030c202d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a Sep 28 15:16:25 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" returned: 0 in 0.512s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a Sep 28 15:16:26 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-581cfe05-0a2c-4f61-ae13-0dc0c4b60653-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-581cfe05-0a2c-4f61-ae13-0dc0c4b60653-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "cinder-quobyte-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec206f0-f322-4a36-8353-007071184e20]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" returned: 0 in 0.558s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "cinder-quobyte-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a" released by "delete_volume" :: held 1.164s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:26 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack cinder-volume[87124]: WARNING cinder.quota [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:16:26 devstack cinder-volume[87124]: WARNING cinder.quota [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:16:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Created reservations ['ebc02d25-1fec-4246-b134-92ee6583f119', 'aee87817-7ebe-467a-b107-aff7bc6ee895', 'd9b47544-b05b-4147-9e92-9072bdffc0c4', 'a4b37026-745f-40b1-979c-6b3c33a96267'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c7b5b9-4ee3-488c-836f-bd9c263dd871]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:27 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 Sep 28 15:16:27 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" returned: 0 in 0.759s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653 Sep 28 15:16:27 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.433s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Deleted volume successfully. Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2f4da523-8606-4f2c-90af-afaacc816283 tempest-VolumeAndVolumeTypeFromImageTest-2010965138 None] Lock "cinder-fdc0fa7b-d521-400b-ae63-715aa5bf3f9a-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:27 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" returned: 0 in 0.339s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-quobyte-581cfe05-0a2c-4f61-ae13-0dc0c4b60653" released by "delete_volume" :: held 1.205s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:27 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29" returned: 0 in 0.538s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c322df0-c5a8-49a4-841f-4fddfd4d88ad]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Created reservations ['0829aaa2-782e-4dda-9a26-bac2e713ff12', 'e74728bd-adf6-4dcc-af2a-ed3663d8105d', 'ff1de6b4-4ed9-41b0-8ea1-f45d9429526c', 'c2942daf-eff4-4c12-806c-70b0b1148380'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:28 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 Sep 28 15:16:28 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:28 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:28 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.326s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Deleted volume successfully. Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-42963857-35b1-49a7-94f9-a95d0b51cee1 tempest-CreateVolumesFromSnapshotTest-1816737594 None] Lock "cinder-581cfe05-0a2c-4f61-ae13-0dc0c4b60653-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:28 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29" returned: 0 in 0.761s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 /opt/stack/data/cinder/conversion/9fac5da6-4271-4641-906a-f9c380c2fa29.temp_image.1ec7f8f7-65f8-46c3-aedf-377532846c7cth3qt753.img {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 /opt/stack/data/cinder/conversion/9fac5da6-4271-4641-906a-f9c380c2fa29.temp_image.1ec7f8f7-65f8-46c3-aedf-377532846c7cth3qt753.img Sep 28 15:16:28 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-63871d81-4c19-4627-83f5-8ddcfc8dd527 req-23a46208-c2b2-43ca-9d11-3973d507e105 tempest-TestShelveInstance-1913037702 None] Terminate volume connection completed successfully. Sep 28 15:16:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-63871d81-4c19-4627-83f5-8ddcfc8dd527 req-23a46208-c2b2-43ca-9d11-3973d507e105 tempest-TestShelveInstance-1913037702 None] Deleting attachment e09830bc-16db-4909-910c-f3c42d2c8f21. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:37 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:16:37 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:38 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.824s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:16:38 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 /opt/stack/data/cinder/conversion/9fac5da6-4271-4641-906a-f9c380c2fa29.temp_image.1ec7f8f7-65f8-46c3-aedf-377532846c7cth3qt753.img" returned: 0 in 10.230s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe27f3-7fb9-4b79-86b0-dc8f37849023]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:38 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 Sep 28 15:16:38 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:39 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29" returned: 0 in 0.786s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:39 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29, size 1024.00 MB, duration 10.23 sec, destination /opt/stack/data/cinder/conversion/9fac5da6-4271-4641-906a-f9c380c2fa29.temp_image.1ec7f8f7-65f8-46c3-aedf-377532846c7cth3qt753.img {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:39 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Converted 1024.00 MB image at 100.09 MB/s Sep 28 15:16:39 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] 1ec7f8f7-65f8-46c3-aedf-377532846c7c was raw, no need to convert to raw {{(pid=87124) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:16:39 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Flow 'volume_create_manager' (a37d1e11-8703-4ef7-b5cb-57be2cd5c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc0ffcd-e283-4c94-873a-f2b6eeb2b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc0ffcd-e283-4c94-873a-f2b6eeb2b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439388341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e59fe6fd74c421ba365eec57109f039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:40Z,use_quota=True,user_id='cefe4aa34abf48eeb832e18689c50fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d50e55e-0cba-4031-859b-c450fb090291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d50e55e-0cba-4031-859b-c450fb090291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd03f89-0f9a-49b5-ac52-4fa72395418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd03f89-0f9a-49b5-ac52-4fa72395418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e', 'volume_name': 'volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c8355b-3c7f-4d74-96a9-d7256c304f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c8355b-3c7f-4d74-96a9-d7256c304f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0e29ae-288d-49a7-9a32-faeaff8c777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Volume 6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e', 'volume_size': 1} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (79608d44-8de2-478c-9a89-b28e9fa6cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02cbdc1-c9fd-4e65-b481-e28add2f2528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02cbdc1-c9fd-4e65-b481-e28add2f2528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1068810816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354dfb01-7700-4e39-8c46-7d5bf6b5ccd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:40Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cb0455-44ab-4546-9172-30dd7d828f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cb0455-44ab-4546-9172-30dd7d828f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb50376a-d0c4-41bc-9183-07bbf208ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb50376a-d0c4-41bc-9183-07bbf208ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354dfb01-7700-4e39-8c46-7d5bf6b5ccd0', 'volume_name': 'volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa626d09-9c9c-40ef-97d3-1884ee93d2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa626d09-9c9c-40ef-97d3-1884ee93d2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d7422-5443-47b7-ae9c-d90cb1ef60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume 354dfb01-7700-4e39-8c46-7d5bf6b5ccd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0', 'volume_size': 1} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-3c31cc36-9ed6-4750-8594-990e40d8493b req-78a9345c-2025-4462-9c73-bbfc03cf12d2 tempest-TestShelveInstance-1913037702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:50 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=31,cinder:INSERT=14,cinder:UPDATE=42,cinder:DELETE=5 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:50 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=27,cinder:SELECT=30,cinder:INSERT=10 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.538s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Uploaded volume to glance image-id: 1ec7f8f7-65f8-46c3-aedf-377532846c7c. {{(pid=87124) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.533s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439388341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e59fe6fd74c421ba365eec57109f039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:40Z,use_quota=True,user_id='cefe4aa34abf48eeb832e18689c50fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Creating volume 6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:01 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:01 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e 1073741824 Sep 28 15:17:01 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f460a376-3085-49eb-aa02-3289f69d0f94 tempest-TestImageHashVerification-1086954639 None] Copy volume to image completed successfully. Sep 28 15:17:02 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e 1073741824" returned: 0 in 0.512s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e Sep 28 15:17:02 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:02 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e" returned: 0 in 0.278s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.846s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1068810816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354dfb01-7700-4e39-8c46-7d5bf6b5ccd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:40Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Creating volume 354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:02 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0e29ae-288d-49a7-9a32-faeaff8c777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:02 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 1073741824 Sep 28 15:17:02 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3df010b-0202-4550-ba6d-25fc2a07c23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Volume volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e (6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e): created successfully Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3df010b-0202-4550-ba6d-25fc2a07c23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Flow 'volume_create_manager' (a37d1e11-8703-4ef7-b5cb-57be2cd5c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-25cd4307-7205-4691-927a-c30474f7141f tempest-ProjectReaderTests-65139009 None] Created volume successfully. Sep 28 15:17:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Acquiring lock "cinder-9fac5da6-4271-4641-906a-f9c380c2fa29-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Lock "cinder-9fac5da6-4271-4641-906a-f9c380c2fa29-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Acquiring lock "cinder-quobyte-9fac5da6-4271-4641-906a-f9c380c2fa29" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Acquiring lock "cinder-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Lock "cinder-quobyte-9fac5da6-4271-4641-906a-f9c380c2fa29" acquired by "delete_volume" :: waited 0.042s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Lock "cinder-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4a059-c312-4e6b-a0fd-97465130d606]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 1073741824" returned: 0 in 0.727s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Acquiring lock "cinder-quobyte-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Lock "cinder-quobyte-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f0526-c09d-4ef3-812c-1d1c94dfaa3e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:03 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 Sep 28 15:17:03 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e Sep 28 15:17:03 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0" returned: 0 in 0.315s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-3c31cc36-9ed6-4750-8594-990e40d8493b req-78a9345c-2025-4462-9c73-bbfc03cf12d2 tempest-TestShelveInstance-1913037702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 22.729s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-3c31cc36-9ed6-4750-8594-990e40d8493b req-78a9345c-2025-4462-9c73-bbfc03cf12d2 tempest-TestShelveInstance-1913037702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d7422-5443-47b7-ae9c-d90cb1ef60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740e7571-5379-4333-b93c-00958347df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:03 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29" returned: 0 in 0.535s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 (354dfb01-7700-4e39-8c46-7d5bf6b5ccd0): created successfully Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740e7571-5379-4333-b93c-00958347df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:03 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29 Sep 28 15:17:03 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (79608d44-8de2-478c-9a89-b28e9fa6cd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3d47f109-022b-4608-8cdc-bf75d068125a tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created volume successfully. Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-3c31cc36-9ed6-4750-8594-990e40d8493b req-78a9345c-2025-4462-9c73-bbfc03cf12d2 tempest-TestShelveInstance-1913037702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc85b18f-a947-4d23-9c42-66a5e91e2e15', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:17:03 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e Sep 28 15:17:03 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-3c31cc36-9ed6-4750-8594-990e40d8493b req-78a9345c-2025-4462-9c73-bbfc03cf12d2 tempest-TestShelveInstance-1913037702 None] attachment_update completed successfully. Sep 28 15:17:04 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9fac5da6-4271-4641-906a-f9c380c2fa29" returned: 0 in 0.388s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Lock "cinder-quobyte-9fac5da6-4271-4641-906a-f9c380c2fa29" released by "delete_volume" :: held 0.999s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e" returned: 0 in 0.331s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Lock "cinder-quobyte-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e" released by "delete_volume" :: held 0.912s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Created reservations ['576d7086-2dee-4f7e-89df-9ec1689bfc98', '229903d9-bb6a-47f7-bd72-3cf5f7300d9f', 'da3feaf9-71aa-4b92-9137-8f02a3dfc75e', 'aa0e5077-5af0-4754-9e55-ae6dd62daa49'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Created reservations ['72c56b0a-9062-4b56-93a6-7acaebc2c8df', '6e0fadaa-17f9-4ca6-9c96-774d54d4354b', '21bfd02d-3b15-496d-8659-b3c783555a3e', '98e88065-ea19-4be0-b0fd-e968ebe677fc'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:04 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:04 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.454s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:04 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.332s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:04 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Deleted volume successfully. Sep 28 15:17:04 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Deleted volume successfully. Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ab61311d-2d00-44f4-83c3-86f651db3eba tempest-TestImageHashVerification-1086954639 None] Lock "cinder-9fac5da6-4271-4641-906a-f9c380c2fa29-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e644d779-f827-458c-8dc3-0f87d216d0ba tempest-ProjectReaderTests-65139009 None] Lock "cinder-6531a0ef-3b97-4b3b-b0c2-7f2e916f8f9e-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (c377545b-21a0-4f88-8482-359bc2473cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84dd0aa0-8fec-4a97-9369-d0e9508dc787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84dd0aa0-8fec-4a97-9369-d0e9508dc787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392322075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c77a15-2f66-41b8-8637-7b15dfcd28a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:05Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c328e2b-eb19-45ed-b797-4d8498701bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c328e2b-eb19-45ed-b797-4d8498701bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da37d59a-52e5-4667-99ce-662299899f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da37d59a-52e5-4667-99ce-662299899f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c77a15-2f66-41b8-8637-7b15dfcd28a5', 'volume_name': 'volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f63e994-949f-48d6-b06b-5b6f1d57f841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f63e994-949f-48d6-b06b-5b6f1d57f841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e05a87-d6d7-4471-8517-627e056a592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:05 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume a7c77a15-2f66-41b8-8637-7b15dfcd28a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5', 'volume_size': 1} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392322075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c77a15-2f66-41b8-8637-7b15dfcd28a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:05Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Creating volume a7c77a15-2f66-41b8-8637-7b15dfcd28a5 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:05 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:05 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 1073741824 Sep 28 15:17:05 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (a97dd2de-8792-4080-bf28-d43f61d64f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bb4ef6-9a89-48f8-9d7d-6706d13e5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bb4ef6-9a89-48f8-9d7d-6706d13e5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870821403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a347963-901f-433b-8e6b-647b0f4c3afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:06Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59824283-fd0d-47df-9125-84fc0e3c3218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59824283-fd0d-47df-9125-84fc0e3c3218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c67f37-fe8e-4548-a02b-677639f01edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c67f37-fe8e-4548-a02b-677639f01edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a347963-901f-433b-8e6b-647b0f4c3afe', 'volume_name': 'volume-0a347963-901f-433b-8e6b-647b0f4c3afe', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd42185d-d1f7-4323-83e0-b8d3e17c2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd42185d-d1f7-4323-83e0-b8d3e17c2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc80f3a4-29bf-4a75-9376-57db5786a09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume 0a347963-901f-433b-8e6b-647b0f4c3afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a347963-901f-433b-8e6b-647b0f4c3afe', 'volume_size': 1} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:06 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 1073741824" returned: 0 in 0.913s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 Sep 28 15:17:06 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5" returned: 0 in 0.509s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870821403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a347963-901f-433b-8e6b-647b0f4c3afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:06Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Creating volume 0a347963-901f-433b-8e6b-647b0f4c3afe {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:06 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e05a87-d6d7-4471-8517-627e056a592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d261288-644d-414c-9f41-8c0a8ff27589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe 1073741824 Sep 28 15:17:07 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 (a7c77a15-2f66-41b8-8637-7b15dfcd28a5): created successfully Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d261288-644d-414c-9f41-8c0a8ff27589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (c377545b-21a0-4f88-8482-359bc2473cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1a83a4d0-a56a-434b-ad08-7225570b31fb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created volume successfully. Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Flow 'volume_create_manager' (71298902-4ef6-46ee-97bf-5ee49c56e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f1e1d1-9de3-489c-ad0c-d4e4ccca36e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f1e1d1-9de3-489c-ad0c-d4e4ccca36e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973057953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba60cb28-7c34-4688-a038-6d44c61bab8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e59fe6fd74c421ba365eec57109f039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:07Z,use_quota=True,user_id='cefe4aa34abf48eeb832e18689c50fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843608c8-472b-42b6-8254-bb6c57f8935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843608c8-472b-42b6-8254-bb6c57f8935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc002cb9-6ed5-428a-9317-411c2a379af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc002cb9-6ed5-428a-9317-411c2a379af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba60cb28-7c34-4688-a038-6d44c61bab8a', 'volume_name': 'volume-ba60cb28-7c34-4688-a038-6d44c61bab8a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647e1b84-fb78-4a2d-96a5-b6ace659d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647e1b84-fb78-4a2d-96a5-b6ace659d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abd25fa-7b52-4f97-ab30-4aed61a84d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Volume ba60cb28-7c34-4688-a038-6d44c61bab8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba60cb28-7c34-4688-a038-6d44c61bab8a', 'volume_size': 1} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (7988a337-1259-4ebc-af62-2ad8814400d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c603e6-1b1c-4e27-ac3f-5d745c0f0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c603e6-1b1c-4e27-ac3f-5d745c0f0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942654929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:07Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1988a7-f497-4f32-990a-f5ad4a547e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1988a7-f497-4f32-990a-f5ad4a547e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f7cc72-d212-463f-a4a2-fd904d62cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f7cc72-d212-463f-a4a2-fd904d62cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4', 'volume_name': 'volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278a7d12-2aed-49fa-8832-4903b24a3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278a7d12-2aed-49fa-8832-4903b24a3889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0086803a-1d26-49a3-9d72-52f38bb20eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume 55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4', 'volume_size': 1} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:07 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (7686a162-8c45-409b-bd8d-574fa45b7698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b149421d-2e48-49ed-bd22-8057a1bd4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe 1073741824" returned: 0 in 0.883s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b149421d-2e48-49ed-bd22-8057a1bd4209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1005429338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d8efb9-2e3e-4ec9-a8c6-892b64b01e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:08Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d79f7a-2d2c-4999-8037-14ea7c591ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d79f7a-2d2c-4999-8037-14ea7c591ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fbcd25-60d4-44e0-bfd9-1cd0027ed50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fbcd25-60d4-44e0-bfd9-1cd0027ed50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d8efb9-2e3e-4ec9-a8c6-892b64b01e64', 'volume_name': 'volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5213284-808f-4914-b5ed-438296f8af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5213284-808f-4914-b5ed-438296f8af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c3f972-3741-450a-be70-764449824158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume 53d8efb9-2e3e-4ec9-a8c6-892b64b01e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64', 'volume_size': 1} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:07 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe Sep 28 15:17:07 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe" returned: 0 in 0.442s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973057953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba60cb28-7c34-4688-a038-6d44c61bab8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e59fe6fd74c421ba365eec57109f039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:07Z,use_quota=True,user_id='cefe4aa34abf48eeb832e18689c50fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Creating volume ba60cb28-7c34-4688-a038-6d44c61bab8a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:08 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:08 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a 1073741824 Sep 28 15:17:08 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc80f3a4-29bf-4a75-9376-57db5786a09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a347963-901f-433b-8e6b-647b0f4c3afe', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cbfca6-ca94-438c-a42d-447daca44606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume volume-0a347963-901f-433b-8e6b-647b0f4c3afe (0a347963-901f-433b-8e6b-647b0f4c3afe): created successfully Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cbfca6-ca94-438c-a42d-447daca44606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (a97dd2de-8792-4080-bf28-d43f61d64f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:08 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a3a84ab1-7132-4443-8719-ddd6bfc0fad9 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created volume successfully. Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (dd067a57-e0ff-444e-94a9-5b081f523359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c8cc87-d662-4b62-8cf0-a9d030d66f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c8cc87-d662-4b62-8cf0-a9d030d66f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72071432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1a3d38-689b-44a2-8459-5b9a5f3190f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:09Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b12acd-30cc-4c49-8017-4c3bc1d913d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b12acd-30cc-4c49-8017-4c3bc1d913d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264317e1-1fc0-4ae1-9984-bef5472080af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264317e1-1fc0-4ae1-9984-bef5472080af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa1a3d38-689b-44a2-8459-5b9a5f3190f7', 'volume_name': 'volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bd49e9-d882-4a1b-9e8f-b9454457b105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bd49e9-d882-4a1b-9e8f-b9454457b105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c49d41-309b-4887-ab6f-99ef7d2fa2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume aa1a3d38-689b-44a2-8459-5b9a5f3190f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7', 'volume_size': 1} Sep 28 15:17:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:09 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a 1073741824" returned: 0 in 1.029s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:09 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a Sep 28 15:17:09 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a" returned: 0 in 0.548s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.564s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942654929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:07Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Creating volume 55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:10 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abd25fa-7b52-4f97-ab30-4aed61a84d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba60cb28-7c34-4688-a038-6d44c61bab8a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031941c1-5134-4f9d-8d46-0d31214a1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:10 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 1073741824 Sep 28 15:17:10 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Volume volume-ba60cb28-7c34-4688-a038-6d44c61bab8a (ba60cb28-7c34-4688-a038-6d44c61bab8a): created successfully Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031941c1-5134-4f9d-8d46-0d31214a1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Flow 'volume_create_manager' (71298902-4ef6-46ee-97bf-5ee49c56e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0934459c-4635-4e01-9186-807c83a7b351 tempest-ProjectReaderTests-65139009 None] Created volume successfully. Sep 28 15:17:10 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 1073741824" returned: 0 in 0.768s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 Sep 28 15:17:11 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Acquiring lock "cinder-ba60cb28-7c34-4688-a038-6d44c61bab8a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Lock "cinder-ba60cb28-7c34-4688-a038-6d44c61bab8a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Acquiring lock "cinder-quobyte-ba60cb28-7c34-4688-a038-6d44c61bab8a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Lock "cinder-quobyte-ba60cb28-7c34-4688-a038-6d44c61bab8a" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:11 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4" returned: 0 in 0.434s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.504s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1005429338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d8efb9-2e3e-4ec9-a8c6-892b64b01e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:08Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Creating volume 53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:11 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e1e407-69c2-4cf9-b7c8-e88e0ca2421b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 1073741824 Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0086803a-1d26-49a3-9d72-52f38bb20eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:11 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e86122-9e45-4797-a6fd-6722875e582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:11 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 (55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4): created successfully Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e86122-9e45-4797-a6fd-6722875e582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (7988a337-1259-4ebc-af62-2ad8814400d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-fc4f3516-daf5-41d1-82fd-37e30e064998 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created volume successfully. Sep 28 15:17:11 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a Sep 28 15:17:11 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a" returned: 0 in 0.714s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:12 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a Sep 28 15:17:12 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 1073741824" returned: 0 in 1.004s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:12 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 Sep 28 15:17:12 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ba60cb28-7c34-4688-a038-6d44c61bab8a" returned: 0 in 0.499s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Lock "cinder-quobyte-ba60cb28-7c34-4688-a038-6d44c61bab8a" released by "delete_volume" :: held 1.317s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Created reservations ['01899941-0c4e-4550-aba4-9dd710d44847', 'b214d88a-b7f6-41ec-a316-c18e1787c66d', '5cd04971-d5b9-4532-8b30-818e55c49b4d', 'ce625661-2fd2-46be-9407-d0da61699d7d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:12 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64" returned: 0 in 0.460s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.981s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72071432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1a3d38-689b-44a2-8459-5b9a5f3190f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5a075058443418acadadd813ff865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:09Z,use_quota=True,user_id='2cf03064ce784777a1ca72eae2f9056a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Creating volume aa1a3d38-689b-44a2-8459-5b9a5f3190f7 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:12 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:17:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 1073741824 Sep 28 15:17:13 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c3f972-3741-450a-be70-764449824158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0502d764-7691-46c7-bc83-13b8d575a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:13 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 (53d8efb9-2e3e-4ec9-a8c6-892b64b01e64): created successfully Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0502d764-7691-46c7-bc83-13b8d575a461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (7686a162-8c45-409b-bd8d-574fa45b7698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a29e536b-7e1c-4569-87f1-a303529fe904 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created volume successfully. Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:13 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:13 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.607s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Deleted volume successfully. Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-86a3e0cd-af94-448b-a148-ea735ee37ced tempest-ProjectReaderTests-65139009 None] Lock "cinder-ba60cb28-7c34-4688-a038-6d44c61bab8a-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:13 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 1073741824" returned: 0 in 0.929s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 Sep 28 15:17:13 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7" returned: 0 in 0.354s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c49d41-309b-4887-ab6f-99ef7d2fa2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aecc2ff-0b83-46da-ad26-8aa5c7a465d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Volume volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 (aa1a3d38-689b-44a2-8459-5b9a5f3190f7): created successfully Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aecc2ff-0b83-46da-ad26-8aa5c7a465d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Flow 'volume_create_manager' (dd067a57-e0ff-444e-94a9-5b081f523359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1e3ad1d0-b494-44f8-bd53-8a59b8df2354 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created volume successfully. Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-aa1a3d38-689b-44a2-8459-5b9a5f3190f7-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-aa1a3d38-689b-44a2-8459-5b9a5f3190f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-quobyte-aa1a3d38-689b-44a2-8459-5b9a5f3190f7" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-aa1a3d38-689b-44a2-8459-5b9a5f3190f7" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e608d1-a479-45f7-a173-175805c213a2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 Sep 28 15:17:15 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7" returned: 0 in 0.779s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7 Sep 28 15:17:15 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:16 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-aa1a3d38-689b-44a2-8459-5b9a5f3190f7" returned: 0 in 0.544s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-aa1a3d38-689b-44a2-8459-5b9a5f3190f7" released by "delete_volume" :: held 1.410s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created reservations ['f6f1a0e9-f95d-49aa-8fdf-40b225bb1349', 'e4f7bf19-b5c8-4ce0-b043-4f48902328ad', '131259ef-098a-456f-bc8e-c4ace0c63739', 'ec802084-7d97-4974-baee-b4e7d75eacef'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:16 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:16 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:17 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.386s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Deleted volume successfully. Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3f60d5d7-727f-4379-adc4-88466a48ad45 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-aa1a3d38-689b-44a2-8459-5b9a5f3190f7-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-quobyte-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[82428623-fe51-4b7d-96ce-7322079baaf7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:17 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 Sep 28 15:17:17 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:18 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64" returned: 0 in 0.815s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:18 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64 Sep 28 15:17:18 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:18 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64" returned: 0 in 0.589s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64" released by "delete_volume" :: held 1.491s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created reservations ['59078295-eb86-4104-b1ab-9956f0d7ec9f', '72cd32f3-326d-4703-aa12-dba3379ca6cb', '2a7467f9-00f3-4567-85d2-6563537246c8', '2e51c116-f7fd-41c5-9350-946354d972a5'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:19 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:19 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:19 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.485s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Deleted volume successfully. Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d44523d5-4d96-4b19-b6e2-84980503c5b0 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-53d8efb9-2e3e-4ec9-a8c6-892b64b01e64-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-quobyte-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db037c-d8d5-4860-bd76-dfd42b1ec053]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 Sep 28 15:17:20 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4" returned: 0 in 0.616s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4 Sep 28 15:17:20 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4" returned: 0 in 0.533s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4" released by "delete_volume" :: held 1.220s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created reservations ['181df538-f178-41ed-8d06-a36d1136ce2e', '6ccbb3a3-eb6f-4bfc-8839-319798270113', '9e906ada-7d23-4296-92cd-267d21d21bd6', '296fcbe4-b20d-4eea-af30-78b3e64422ed'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:21 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Deleted volume successfully. Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-36796f96-e421-478f-9d02-08836ee599d3 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-55071f49-6cc2-43c9-a9d5-3fb4c1ec26d4-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-0a347963-901f-433b-8e6b-647b0f4c3afe-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-0a347963-901f-433b-8e6b-647b0f4c3afe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-quobyte-0a347963-901f-433b-8e6b-647b0f4c3afe" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-0a347963-901f-433b-8e6b-647b0f4c3afe" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1afb74-22be-4191-a217-a8f745ec4491]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:22 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe Sep 28 15:17:22 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe" returned: 0 in 0.687s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe Sep 28 15:17:23 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0a347963-901f-433b-8e6b-647b0f4c3afe" returned: 0 in 0.389s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-0a347963-901f-433b-8e6b-647b0f4c3afe" released by "delete_volume" :: held 1.141s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created reservations ['deaf3f9d-4279-4476-914d-def21daa444b', '296ee02a-9efa-4be2-96bb-6c5ccca08acd', '9b7e43c0-4269-4767-94f6-29974f7c3573', 'ff873cec-97d8-4d81-80ac-1344012e8df8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:23 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:24 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.457s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:24 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Deleted volume successfully. Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f24e618a-f8da-46ef-86bc-c1c1f09e1b2d tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-0a347963-901f-433b-8e6b-647b0f4c3afe-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-a7c77a15-2f66-41b8-8637-7b15dfcd28a5-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-a7c77a15-2f66-41b8-8637-7b15dfcd28a5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-quobyte-a7c77a15-2f66-41b8-8637-7b15dfcd28a5" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-a7c77a15-2f66-41b8-8637-7b15dfcd28a5" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c151cd15-f778-419e-b371-22c270778edd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:25 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 Sep 28 15:17:25 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:25 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5" returned: 0 in 0.638s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:25 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5 Sep 28 15:17:25 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:26 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7c77a15-2f66-41b8-8637-7b15dfcd28a5" returned: 0 in 0.572s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-a7c77a15-2f66-41b8-8637-7b15dfcd28a5" released by "delete_volume" :: held 1.284s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created reservations ['c00a7a83-c91f-4e40-af58-076b49c3e6f4', '800f84cf-2365-451d-95d3-accf4e41dc7e', '041e9c19-034f-4504-b952-1027d3d3b0d2', '7347111f-7727-4fb9-ba16-6dc1f2836deb'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:26 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:26 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:26 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.503s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:26 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Deleted volume successfully. Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1af10628-73a4-41e9-b8eb-df7100bc10eb tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-a7c77a15-2f66-41b8-8637-7b15dfcd28a5-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "cinder-quobyte-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f2fbb-6cbe-4ce9-ac64-3979657f3c7e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:27 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 Sep 28 15:17:27 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:28 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0" returned: 0 in 0.649s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:28 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0 Sep 28 15:17:28 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:28 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0" returned: 0 in 0.481s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-quobyte-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0" released by "delete_volume" :: held 1.206s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Created reservations ['4e3215bf-b270-4792-97c8-8d3de9fb91ab', '3ddd91a5-a691-4ef9-8083-c85dba3f4ebb', '8fa63575-1481-4669-9349-56d6a36989bd', '7eec73b2-1a0d-4b38-9b2e-2d41bd2c5082'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:28 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:28 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:29 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.350s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:29 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Deleted volume successfully. Sep 28 15:17:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c6d79035-9316-4d44-80e7-e6d4e629e869 tempest-CreateVolumesFromSourceVolumeTest-371472119 None] Lock "cinder-354dfb01-7700-4e39-8c46-7d5bf6b5ccd0-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:37 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:17:37 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:37 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.391s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:17:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:17:39 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=97,cinder:SELECT=77,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=54,cinder:UPDATE=98,cinder:INSERT=15,cinder:DELETE=10 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-647dc2e4-c8bb-4132-b087-c1fe987b3e93 tempest-TestShelveInstance-1913037702 None] Terminate volume connection completed successfully. Sep 28 15:17:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-647dc2e4-c8bb-4132-b087-c1fe987b3e93 tempest-TestShelveInstance-1913037702 None] Deleting attachment dc85b18f-a947-4d23-9c42-66a5e91e2e15. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Acquiring lock "cinder-30f4b05f-99f8-41e4-a3e0-a22414b161bc-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Lock "cinder-30f4b05f-99f8-41e4-a3e0-a22414b161bc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Acquiring lock "cinder-quobyte-30f4b05f-99f8-41e4-a3e0-a22414b161bc" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Lock "cinder-quobyte-30f4b05f-99f8-41e4-a3e0-a22414b161bc" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7dec01-aca0-4d9b-94d1-bec94fcf889f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:59 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc Sep 28 15:17:59 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:59 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc" returned: 0 in 0.514s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:59 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc Sep 28 15:17:59 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-30f4b05f-99f8-41e4-a3e0-a22414b161bc" returned: 0 in 0.480s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Lock "cinder-quobyte-30f4b05f-99f8-41e4-a3e0-a22414b161bc" released by "delete_volume" :: held 1.081s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG cinder.quota [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Created reservations ['71f0310d-e407-47b8-9679-0f46d3e0732b', 'fc66a2eb-0ffe-4aa5-8f9f-4516ded72972', '99ba1a5b-028f-46ac-9463-4f26fa53d2a1', 'ce3c5636-29f3-48ce-8f10-7876393a34b3'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:00 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.399s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[87124]: DEBUG cinder.manager [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Deleted volume successfully. Sep 28 15:18:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [req-6a101ba5-0222-4031-a8b5-e1b7ec3ba7fb req-cb8168ac-0a66-4687-9784-52bd7e258285 tempest-TestShelveInstance-1913037702 None] Lock "cinder-30f4b05f-99f8-41e4-a3e0-a22414b161bc-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Flow 'volume_create_manager' (dda88751-857a-4914-a73d-d33fcd28d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fa1930-4fd3-40b4-a5d1-b701b515861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fa1930-4fd3-40b4-a5d1-b701b515861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-775029846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc424ff-a06f-415c-ac59-8366a6903197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67256e3e8f14f4ab1b33186f317a82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:05Z,use_quota=True,user_id='739f2be3222647958ab99acdb76ca54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7128e714-84c0-4c27-9dbb-8fd23e6be567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7128e714-84c0-4c27-9dbb-8fd23e6be567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dbefbf-5a9b-4c9b-b59f-e781d47bcad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dbefbf-5a9b-4c9b-b59f-e781d47bcad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc424ff-a06f-415c-ac59-8366a6903197', 'volume_name': 'volume-dfc424ff-a06f-415c-ac59-8366a6903197', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4349987e-23b2-4a3f-91de-fbee910c210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4349987e-23b2-4a3f-91de-fbee910c210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55edb702-1032-405c-a6c6-2661867b1c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Volume dfc424ff-a06f-415c-ac59-8366a6903197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc424ff-a06f-415c-ac59-8366a6903197', 'volume_size': 1} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-775029846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc424ff-a06f-415c-ac59-8366a6903197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67256e3e8f14f4ab1b33186f317a82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:05Z,use_quota=True,user_id='739f2be3222647958ab99acdb76ca54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Creating volume dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:05 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 1073741824 Sep 28 15:18:05 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 1073741824" returned: 0 in 0.692s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 Sep 28 15:18:05 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:06 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197" returned: 0 in 0.354s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55edb702-1032-405c-a6c6-2661867b1c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc424ff-a06f-415c-ac59-8366a6903197', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4783cb-7757-4ee7-a184-5cb13f055787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Volume volume-dfc424ff-a06f-415c-ac59-8366a6903197 (dfc424ff-a06f-415c-ac59-8366a6903197): created successfully Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4783cb-7757-4ee7-a184-5cb13f055787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Flow 'volume_create_manager' (dda88751-857a-4914-a73d-d33fcd28d394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-83c0846f-6d49-40fa-8e88-a81c0672539b tempest-SnapshotDependencyTests-1898579237 None] Created volume successfully. Sep 28 15:18:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Creating offline snapshot 8e2d723d-fc6a-4026-8e5b-11b85ff9e08d of volume dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:07 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9db1c-9034-4ea9-8bc8-bdcf272a48b3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:07 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 Sep 28 15:18:07 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:08 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197" returned: 0 in 0.519s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:08 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d 1G Sep 28 15:18:08 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:08 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d 1G" returned: 0 in 0.560s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc424ff-a06f-415c-ac59-8366a6903197 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:08 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc424ff-a06f-415c-ac59-8366a6903197 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d Sep 28 15:18:08 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc424ff-a06f-415c-ac59-8366a6903197 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" returned: 0 in 0.452s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d is being set with open permissions: ugo+rw Sep 28 15:18:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d Sep 28 15:18:09 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" returned: 0 in 0.356s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info Sep 28 15:18:09 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info is being set with open permissions: ugo+rw Sep 28 15:18:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info Sep 28 15:18:09 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:10 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.info" returned: 0 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-14cdff3d-66f9-4c85-9734-f77f1eaa6ae3 tempest-SnapshotDependencyTests-1898579237 None] Create snapshot completed successfully Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Flow 'volume_create_manager' (8847a6e0-8db4-4449-bfb1-38e0412ad8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65922f82-fbc0-41fa-b789-faeb265f7e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65922f82-fbc0-41fa-b789-faeb265f7e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1245518776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700e3ba6-42fe-4127-bf86-feb02fc0d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d856d758c34081842bb3334073d943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='00b77dee1e9747cd8c578dd508091ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1ad2fd-d666-492f-9cc4-b7968fb5417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1ad2fd-d666-492f-9cc4-b7968fb5417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d11db4-8a17-4da5-a6b3-34713e7d8c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d11db4-8a17-4da5-a6b3-34713e7d8c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '700e3ba6-42fe-4127-bf86-feb02fc0d1bd', 'volume_name': 'volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec04bfd2-588f-4ac7-9582-ac1701f493fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec04bfd2-588f-4ac7-9582-ac1701f493fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de7c3d-0f65-4c41-b010-817b427fb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Volume 700e3ba6-42fe-4127-bf86-feb02fc0d1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd', 'volume_size': 1} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1245518776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700e3ba6-42fe-4127-bf86-feb02fc0d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d856d758c34081842bb3334073d943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='00b77dee1e9747cd8c578dd508091ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Creating volume 700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:10 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:18:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:10 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd 1073741824 Sep 28 15:18:10 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:11 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd 1073741824" returned: 0 in 0.626s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:11 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd Sep 28 15:18:11 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Flow 'volume_create_manager' (47091fc1-960a-456e-946a-3c57feb5b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42992397-9183-420f-a6d7-7e6550425979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42992397-9183-420f-a6d7-7e6550425979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68af625a-9d3d-47e6-874e-ab867bdc4b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67256e3e8f14f4ab1b33186f317a82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e2d723d-fc6a-4026-8e5b-11b85ff9e08d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:12Z,use_quota=True,user_id='739f2be3222647958ab99acdb76ca54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6060d5b-3b83-42da-b494-2d44bf3c9198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6060d5b-3b83-42da-b494-2d44bf3c9198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0f10c5-9636-457f-a640-dea9ff035f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0f10c5-9636-457f-a640-dea9ff035f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68af625a-9d3d-47e6-874e-ab867bdc4b91', 'volume_name': 'volume-68af625a-9d3d-47e6-874e-ab867bdc4b91', 'volume_size': 1, 'snapshot_id': '8e2d723d-fc6a-4026-8e5b-11b85ff9e08d'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327dc960-80e0-4075-ac75-5ec87b835844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327dc960-80e0-4075-ac75-5ec87b835844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a9c7a2-29e4-40b5-80d8-59952d833f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Volume 68af625a-9d3d-47e6-874e-ab867bdc4b91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68af625a-9d3d-47e6-874e-ab867bdc4b91', 'volume_size': 1, 'snapshot_id': '8e2d723d-fc6a-4026-8e5b-11b85ff9e08d'} Sep 28 15:18:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:12 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" returned: 0 in 0.397s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.126s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-quobyte-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d-68af625a-9d3d-47e6-874e-ab867bdc4b91" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de7c3d-0f65-4c41-b010-817b427fb025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca42b99f-c7ca-4d7f-955a-2f11b97abcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d-68af625a-9d3d-47e6-874e-ab867bdc4b91" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Creating volume 68af625a-9d3d-47e6-874e-ab867bdc4b91 from snapshot 8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-quobyte-68af625a-9d3d-47e6-874e-ab867bdc4b91" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:12 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Volume volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd (700e3ba6-42fe-4127-bf86-feb02fc0d1bd): created successfully Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca42b99f-c7ca-4d7f-955a-2f11b97abcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Flow 'volume_create_manager' (8847a6e0-8db4-4449-bfb1-38e0412ad8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-68af625a-9d3d-47e6-874e-ab867bdc4b91" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] snapshot: 8e2d723d-fc6a-4026-8e5b-11b85ff9e08d, volume: 68af625a-9d3d-47e6-874e-ab867bdc4b91, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:18:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e426a2a7-b2cf-4196-8776-2a0b961ff071 tempest-TestStampPattern-722328113 None] Created volume successfully. Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c17da94-ea8b-42a3-83fb-e964bfe14c2d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:12 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d Sep 28 15:18:12 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:12 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" returned: 0 in 0.463s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc424ff-a06f-415c-ac59-8366a6903197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba94884-6c30-4127-a3f1-a8c1a0168026]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:12 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 Sep 28 15:18:12 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:13 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197" returned: 0 in 0.555s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:18:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:18:13 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:18:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 Sep 28 15:18:13 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:22 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=12,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:22 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=4 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:23 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91" returned: 0 in 9.723s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197, size 1024.00 MB, duration 9.72 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:18:23 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Converted 1024.00 MB image at 105.30 MB/s Sep 28 15:18:23 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 is being set with open permissions: ugo+rw Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:23 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 Sep 28 15:18:23 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:23 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91" returned: 0 in 0.422s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-68af625a-9d3d-47e6-874e-ab867bdc4b91" released by "_copy_volume_from_snapshot" :: held 11.330s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d-68af625a-9d3d-47e6-874e-ab867bdc4b91" released by "_create_volume_from_snapshot" :: held 11.472s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.517s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a9c7a2-29e4-40b5-80d8-59952d833f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68af625a-9d3d-47e6-874e-ab867bdc4b91', 'volume_size': 1, 'snapshot_id': '8e2d723d-fc6a-4026-8e5b-11b85ff9e08d'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b5ffba-72fa-4a25-a7e8-65c93d1bfdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Volume volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 (68af625a-9d3d-47e6-874e-ab867bdc4b91): created successfully Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b5ffba-72fa-4a25-a7e8-65c93d1bfdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Flow 'volume_create_manager' (47091fc1-960a-456e-946a-3c57feb5b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f021f101-b88b-4dfa-a70c-bf7324a23e62 tempest-SnapshotDependencyTests-1898579237 None] Created volume successfully. Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-quobyte-dfc424ff-a06f-415c-ac59-8366a6903197" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-dfc424ff-a06f-415c-ac59-8366a6903197" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-quobyte-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Deleting offline snapshot 8e2d723d-fc6a-4026-8e5b-11b85ff9e08d of volume dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] snapshot_file for this snap is: volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[85436bbb-6baa-457f-8c1f-e038795e83e7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:24 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d Sep 28 15:18:24 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" returned: 0 in 0.741s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc424ff-a06f-415c-ac59-8366a6903197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[265eeb73-438e-418d-947d-955d15706e98]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:25 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 Sep 28 15:18:25 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197" returned: 0 in 0.760s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:25 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d Sep 28 15:18:25 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:26 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" returned: 0 in 0.488s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:26 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d Sep 28 15:18:26 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:26 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197.8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" returned: 0 in 0.403s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d" released by "_delete_snapshot" :: held 2.603s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-dfc424ff-a06f-415c-ac59-8366a6903197" released by "delete_snapshot" :: held 2.641s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Created reservations ['3b1fac84-41ee-440b-8927-fa39637d8076', '295bacfe-c7b8-4b6c-8ab7-ec08a404bcf9', '0faac11d-2243-421d-8e6a-c031f1a05ee5', 'ef4783f9-a1ba-430e-83e2-1f9a170f9cd2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Delete snapshot completed successfully. Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1595e9d2-4dbb-45ac-9968-275acbf9beb5 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-8e2d723d-fc6a-4026-8e5b-11b85ff9e08d-delete_snapshot" released by "delete_snapshot" :: held 2.888s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-dfc424ff-a06f-415c-ac59-8366a6903197-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-dfc424ff-a06f-415c-ac59-8366a6903197-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-quobyte-dfc424ff-a06f-415c-ac59-8366a6903197" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-dfc424ff-a06f-415c-ac59-8366a6903197" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f1fb26-8818-401a-bc36-3232c8a8878f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:27 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 Sep 28 15:18:27 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:28 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197" returned: 0 in 0.534s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:28 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197 Sep 28 15:18:28 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:28 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc424ff-a06f-415c-ac59-8366a6903197" returned: 0 in 0.307s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-dfc424ff-a06f-415c-ac59-8366a6903197" released by "delete_volume" :: held 1.004s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:28 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Created reservations ['312ffd2b-05ed-4cdf-b2c9-97ee6c687e48', 'fab92c91-8a7d-4a12-861d-29a9575ec3f9', 'e03a14d5-56ca-4d70-8d8d-69f033db0282', '987b9047-8e01-489f-be8c-d2addae80c67'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:29 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:29 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:29 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.349s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Deleted volume successfully. Sep 28 15:18:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1ea4bac1-4905-4652-ab82-ed3876ec2496 tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-dfc424ff-a06f-415c-ac59-8366a6903197-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-68af625a-9d3d-47e6-874e-ab867bdc4b91-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-68af625a-9d3d-47e6-874e-ab867bdc4b91-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "cinder-quobyte-68af625a-9d3d-47e6-874e-ab867bdc4b91" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-68af625a-9d3d-47e6-874e-ab867bdc4b91" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[76307ae8-0d1e-4d80-a457-957f6f88aa8d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:30 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 Sep 28 15:18:30 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:30 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91" returned: 0 in 0.680s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:30 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91 Sep 28 15:18:30 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:31 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-68af625a-9d3d-47e6-874e-ab867bdc4b91" returned: 0 in 0.411s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-quobyte-68af625a-9d3d-47e6-874e-ab867bdc4b91" released by "delete_volume" :: held 1.146s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Created reservations ['24ff967a-480f-47bf-abfd-e845d3900350', '94b11af5-c2ac-4f8c-a6cf-4b834a237192', '23f4daf2-64d5-4c0f-8b5e-3f3593197746', 'eebaeafd-4733-445c-ac53-156f42552932'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:31 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:31 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:31 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:31 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Flow 'volume_create_manager' (8b8ed0fc-d76c-4951-bf21-860a64965f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba5b683-0390-4e88-9c5b-c19c4ac8c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.394s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Deleted volume successfully. Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba5b683-0390-4e88-9c5b-c19c4ac8c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e01055a-d258-4925-9ce7-940525191d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c10868984e4121bc9b633e4994574d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:32Z,use_quota=True,user_id='d659d0d313e0438997cfe4f7e765eda3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e96431-c981-4433-84e6-4d6a5718705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e96431-c981-4433-84e6-4d6a5718705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc2e443-04bc-4006-b5fa-88b599d82647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-efd3a5bc-7743-44c1-a3b9-20a9d529998b tempest-SnapshotDependencyTests-1898579237 None] Lock "cinder-68af625a-9d3d-47e6-874e-ab867bdc4b91-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc2e443-04bc-4006-b5fa-88b599d82647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e01055a-d258-4925-9ce7-940525191d81', 'volume_name': 'volume-4e01055a-d258-4925-9ce7-940525191d81', 'volume_size': 1, 'image_id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '785bba84096245f38a7482516f831acb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4c10868984e4121bc9b633e4994574d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '851b9c495a7a7bd75bc7835d37eca56c3b094daede08640e9c3cff6a062cd3742ec158206ccf1018c9b5b98c272818de060041fcf76b2d08f40e8574d332e561', 'id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'created_at': datetime.datetime(2026, 9, 28, 13, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 18, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9/file', 'properties': {}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7057c4d1-88b4-46ce-9b8d-aab4db5a6855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7057c4d1-88b4-46ce-9b8d-aab4db5a6855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1767a8f2-108c-4d1a-92cf-c495586428e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Volume 4e01055a-d258-4925-9ce7-940525191d81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e01055a-d258-4925-9ce7-940525191d81', 'volume_size': 1, 'image_id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '785bba84096245f38a7482516f831acb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4c10868984e4121bc9b633e4994574d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '851b9c495a7a7bd75bc7835d37eca56c3b094daede08640e9c3cff6a062cd3742ec158206ccf1018c9b5b98c272818de060041fcf76b2d08f40e8574d332e561', 'id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'created_at': datetime.datetime(2026, 9, 28, 13, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 18, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9/file', 'properties': {}}, 'image_service': } Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Trying to clone 4e01055a-d258-4925-9ce7-940525191d81 from image 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:18:32 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d674f-7e52-4294-80c1-2549a63ddb3d]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:32 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD Sep 28 15:18:32 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:32 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD Sep 28 15:18:33 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:33 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Temporary image 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 is fetched for user d659d0d313e0438997cfe4f7e765eda3. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ae83f9-9c54-440e-94d0-66d06dfdddb2]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD Sep 28 15:18:33 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:33 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:34 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD Sep 28 15:18:34 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:34 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e01055a-d258-4925-9ce7-940525191d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c10868984e4121bc9b633e4994574d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:32Z,use_quota=True,user_id='d659d0d313e0438997cfe4f7e765eda3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Creating volume 4e01055a-d258-4925-9ce7-940525191d81 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:34 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:34 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 1073741824 Sep 28 15:18:34 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:34 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 1073741824" returned: 0 in 0.636s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:35 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 Sep 28 15:18:35 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:35 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81" returned: 0 in 0.333s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Attempting download of 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'metadata': {}}])) to volume 4e01055a-d258-4925-9ce7-940525191d81. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a892096e-9d76-4206-943d-41f78db90fc2]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:35 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41 Sep 28 15:18:35 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:35 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41" returned: 0 in 0.397s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:35 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41 Sep 28 15:18:35 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:36 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41" returned: 1 in 0.371s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_ut68_s41' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:36 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2faa3d5-1f1e-4178-9081-1374d41f9ac4]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:36 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD Sep 28 15:18:36 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:36 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:36 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD Sep 28 15:18:36 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:37 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 was raw, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:37 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 Sep 28 15:18:37 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:37 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:37 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:37 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.329s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:18:37 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81" returned: 0 in 0.669s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8aa1768f-57a2-4aff-9184-ff7e1eae4ed9_tiedasbqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:18:37 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:18:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:37 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 1G Sep 28 15:18:37 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:38 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 1G" returned: 0 in 0.485s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Downloaded image 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'metadata': {}}])) to volume 4e01055a-d258-4925-9ce7-940525191d81 successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Temporary image 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 for user d659d0d313e0438997cfe4f7e765eda3 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Marking volume 4e01055a-d258-4925-9ce7-940525191d81 as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Copying metadata from image 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 to 4e01055a-d258-4925-9ce7-940525191d81. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Creating volume glance metadata for volume 4e01055a-d258-4925-9ce7-940525191d81 backed by image 8aa1768f-57a2-4aff-9184-ff7e1eae4ed9 with: {'image_id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '785bba84096245f38a7482516f831acb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1767a8f2-108c-4d1a-92cf-c495586428e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e01055a-d258-4925-9ce7-940525191d81', 'volume_size': 1, 'image_id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '785bba84096245f38a7482516f831acb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4c10868984e4121bc9b633e4994574d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '851b9c495a7a7bd75bc7835d37eca56c3b094daede08640e9c3cff6a062cd3742ec158206ccf1018c9b5b98c272818de060041fcf76b2d08f40e8574d332e561', 'id': '8aa1768f-57a2-4aff-9184-ff7e1eae4ed9', 'created_at': datetime.datetime(2026, 9, 28, 13, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 18, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8aa1768f-57a2-4aff-9184-ff7e1eae4ed9/file', 'properties': {}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72e9198-46c0-4be8-8040-ba7400f86ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:38 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Volume volume-4e01055a-d258-4925-9ce7-940525191d81 (4e01055a-d258-4925-9ce7-940525191d81): created successfully Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72e9198-46c0-4be8-8040-ba7400f86ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Flow 'volume_create_manager' (8b8ed0fc-d76c-4951-bf21-860a64965f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-04ab7618-0029-454f-b921-99994164aa3e tempest-VolumeImageDependencyTests-1955069543 None] Created volume successfully. Sep 28 15:18:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Acquiring lock "cinder-4e01055a-d258-4925-9ce7-940525191d81-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Lock "cinder-4e01055a-d258-4925-9ce7-940525191d81-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Acquiring lock "cinder-quobyte-4e01055a-d258-4925-9ce7-940525191d81" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Lock "cinder-quobyte-4e01055a-d258-4925-9ce7-940525191d81" acquired by "delete_volume" :: waited 0.015s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[464dab07-2c8d-42cd-bcd8-3c402506bf61]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:39 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 Sep 28 15:18:39 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81" returned: 0 in 0.431s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:40 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81 Sep 28 15:18:40 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4e01055a-d258-4925-9ce7-940525191d81" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Lock "cinder-quobyte-4e01055a-d258-4925-9ce7-940525191d81" released by "delete_volume" :: held 0.754s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Created reservations ['44151726-d085-433c-ad68-acf146a00571', '89f48034-8493-4876-8408-57fcb77606bc', '8cd53f26-2057-4736-8ab4-8c1d406803f0', 'f7863e3b-9286-4b4b-aa60-9bf70405e9c0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:40 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:40 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.295s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Deleted volume successfully. Sep 28 15:18:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3febbe9e-98fa-41e6-84b0-750455604bf4 tempest-VolumeImageDependencyTests-1955069543 None] Lock "cinder-4e01055a-d258-4925-9ce7-940525191d81-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Flow 'volume_create_manager' (e7347786-c333-4578-a966-f0dec1ec0e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a388e319-a612-46af-af51-e8d1240d9b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a388e319-a612-46af-af51-e8d1240d9b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bb1fe0-d18c-40fd-a791-21a812a58f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520c96750d7841ebbb4b9978df354271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:45Z,use_quota=True,user_id='0ad8078e6cbe4220ad0f1dac8bcba432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3159a8-3c84-4607-a8d5-87be5693acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3159a8-3c84-4607-a8d5-87be5693acd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee91e23-a7b8-42a3-bfc9-3cfb7c765330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee91e23-a7b8-42a3-bfc9-3cfb7c765330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bb1fe0-d18c-40fd-a791-21a812a58f65', 'volume_name': 'volume-32bb1fe0-d18c-40fd-a791-21a812a58f65', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d164df0-4b66-49c0-808a-9705b576900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d164df0-4b66-49c0-808a-9705b576900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70f1943-8780-4217-99ca-e6ab507032bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Volume 32bb1fe0-d18c-40fd-a791-21a812a58f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bb1fe0-d18c-40fd-a791-21a812a58f65', 'volume_size': 1} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bb1fe0-d18c-40fd-a791-21a812a58f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520c96750d7841ebbb4b9978df354271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:45Z,use_quota=True,user_id='0ad8078e6cbe4220ad0f1dac8bcba432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Creating volume 32bb1fe0-d18c-40fd-a791-21a812a58f65 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:45 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 1073741824 Sep 28 15:18:45 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 1073741824" returned: 0 in 0.572s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 Sep 28 15:18:45 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65" returned: 0 in 0.335s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70f1943-8780-4217-99ca-e6ab507032bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bb1fe0-d18c-40fd-a791-21a812a58f65', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74942222-a32d-43eb-8e3d-5265989f3ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Volume volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 (32bb1fe0-d18c-40fd-a791-21a812a58f65): created successfully Sep 28 15:18:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74942222-a32d-43eb-8e3d-5265989f3ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Flow 'volume_create_manager' (e7347786-c333-4578-a966-f0dec1ec0e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:46 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bddfaa0c-fe27-4020-a4ae-59a7abe16348 tempest-CinderUnicodeTest-1847883685 None] Created volume successfully. Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Flow 'volume_create_manager' (a23d9be0-1f51-4faf-88a0-9f4158e52087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a819232-4395-4eb0-90f0-dd66b089b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a819232-4395-4eb0-90f0-dd66b089b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-605889890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7cbd58-82d1-49e2-b979-765e580167ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520c96750d7841ebbb4b9978df354271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:48Z,use_quota=True,user_id='0ad8078e6cbe4220ad0f1dac8bcba432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aabdb02-10f9-4f7a-b141-96ee975ec5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aabdb02-10f9-4f7a-b141-96ee975ec5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acb9ee0-fddf-4ab4-b604-c727403bd7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acb9ee0-fddf-4ab4-b604-c727403bd7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7cbd58-82d1-49e2-b979-765e580167ab', 'volume_name': 'volume-5d7cbd58-82d1-49e2-b979-765e580167ab', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b24cfc9-f917-4760-af25-0f8a7e69ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b24cfc9-f917-4760-af25-0f8a7e69ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f074b55e-dd1f-412a-a613-05de35776933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Volume 5d7cbd58-82d1-49e2-b979-765e580167ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7cbd58-82d1-49e2-b979-765e580167ab', 'volume_size': 1} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-605889890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7cbd58-82d1-49e2-b979-765e580167ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520c96750d7841ebbb4b9978df354271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:48Z,use_quota=True,user_id='0ad8078e6cbe4220ad0f1dac8bcba432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Creating volume 5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:47 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:18:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:47 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab 1073741824 Sep 28 15:18:47 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:48 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab 1073741824" returned: 0 in 0.544s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:48 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab Sep 28 15:18:48 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:48 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab" returned: 0 in 0.323s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f074b55e-dd1f-412a-a613-05de35776933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7cbd58-82d1-49e2-b979-765e580167ab', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215cb132-59b7-40db-bd8a-583037159c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Volume volume-5d7cbd58-82d1-49e2-b979-765e580167ab (5d7cbd58-82d1-49e2-b979-765e580167ab): created successfully Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215cb132-59b7-40db-bd8a-583037159c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Flow 'volume_create_manager' (a23d9be0-1f51-4faf-88a0-9f4158e52087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2c9ba840-dcc1-45cf-8c74-647d2c05e98f tempest-CinderUnicodeTest-1847883685 None] Created volume successfully. Sep 28 15:18:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Creating offline snapshot 66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b of volume 5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd09df4-c6b8-4235-a727-848e3f8373bb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:50 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab Sep 28 15:18:50 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:50 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab" returned: 0 in 0.369s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:50 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b 1G Sep 28 15:18:50 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:50 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b 1G" returned: 0 in 0.530s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7cbd58-82d1-49e2-b979-765e580167ab -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:50 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7cbd58-82d1-49e2-b979-765e580167ab -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b Sep 28 15:18:50 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:51 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7cbd58-82d1-49e2-b979-765e580167ab -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:51 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b is being set with open permissions: ugo+rw Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:51 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b Sep 28 15:18:51 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:51 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" returned: 0 in 0.312s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:51 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info Sep 28 15:18:51 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-7540ac73-c6f6-432f-8b3b-947eb452c95a req-b4f4c3a7-30be-4fb2-8820-5515fce8bd61 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:51 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info" returned: 0 in 0.323s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:51 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info is being set with open permissions: ugo+rw Sep 28 15:18:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:51 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info Sep 28 15:18:51 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:52 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.info" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-7540ac73-c6f6-432f-8b3b-947eb452c95a req-b4f4c3a7-30be-4fb2-8820-5515fce8bd61 tempest-TestStampPattern-722328113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.452s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-7540ac73-c6f6-432f-8b3b-947eb452c95a req-b4f4c3a7-30be-4fb2-8820-5515fce8bd61 tempest-TestStampPattern-722328113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-46d3ec72-c4b0-4444-9ede-ea797bd71a7a tempest-CinderUnicodeTest-1847883685 None] Create snapshot completed successfully Sep 28 15:18:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-7540ac73-c6f6-432f-8b3b-947eb452c95a req-b4f4c3a7-30be-4fb2-8820-5515fce8bd61 tempest-TestStampPattern-722328113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cfcc4f6-37be-49ce-a534-305320b09b05', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:18:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-7540ac73-c6f6-432f-8b3b-947eb452c95a req-b4f4c3a7-30be-4fb2-8820-5515fce8bd61 tempest-TestStampPattern-722328113 None] attachment_update completed successfully. Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-quobyte-5d7cbd58-82d1-49e2-b979-765e580167ab" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-5d7cbd58-82d1-49e2-b979-765e580167ab" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-quobyte-66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Deleting offline snapshot 66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b of volume 5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] snapshot_file for this snap is: volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c62933-fc16-41cd-af45-2147ba9b96a7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:53 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b Sep 28 15:18:53 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:53 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" returned: 0 in 0.436s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d7cbd58-82d1-49e2-b979-765e580167ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a8b033-8f53-4712-8e4b-d8b2138084fb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:53 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab Sep 28 15:18:53 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:54 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab" returned: 0 in 0.383s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:54 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b Sep 28 15:18:54 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:54 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" returned: 0 in 0.391s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:54 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b Sep 28 15:18:54 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:54 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab.66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b" released by "_delete_snapshot" :: held 1.608s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-5d7cbd58-82d1-49e2-b979-765e580167ab" released by "delete_snapshot" :: held 1.638s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:54 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Created reservations ['2d04fdde-374e-4224-8fbe-66e6f3af8c83', '5e5bf8b8-7885-4d4c-9cee-ecd9bfb3027f', 'e6aa076a-c070-4ace-a80a-b082ebfb3671', 'b07aa025-4628-484d-baa6-c2457b95b2db'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Delete snapshot completed successfully. Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-71915506-6e78-41fd-a332-ca2902454a0b tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-66edf2b0-f5bd-4b92-bfbb-a42b55d03d7b-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-5d7cbd58-82d1-49e2-b979-765e580167ab-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-5d7cbd58-82d1-49e2-b979-765e580167ab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-quobyte-5d7cbd58-82d1-49e2-b979-765e580167ab" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-5d7cbd58-82d1-49e2-b979-765e580167ab" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2705d9-5cf4-4cae-bc5c-8876c7c2b69e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:55 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab Sep 28 15:18:55 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab" returned: 0 in 0.436s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab Sep 28 15:18:56 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:56 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-5d7cbd58-82d1-49e2-b979-765e580167ab" returned: 0 in 0.307s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-5d7cbd58-82d1-49e2-b979-765e580167ab" released by "delete_volume" :: held 0.818s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Created reservations ['07c2d7f7-3965-4655-aab6-fd2dc7772ab8', 'e72f15e9-e539-45ef-a390-0b43a8e2af3b', '5277c7bf-79a1-4c02-921e-db59dd95ba62', 'bd2a7911-1233-42cd-8cc6-865da996f2f8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:56 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-32bb1fe0-d18c-40fd-a791-21a812a58f65-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-32bb1fe0-d18c-40fd-a791-21a812a58f65-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "cinder-quobyte-32bb1fe0-d18c-40fd-a791-21a812a58f65" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-32bb1fe0-d18c-40fd-a791-21a812a58f65" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:56 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.359s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b1ce29-e8cc-485c-8e71-5738d9874173]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Deleted volume successfully. Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e35f6ede-e7a8-475d-8356-d94a4b7bdd8a tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-5d7cbd58-82d1-49e2-b979-765e580167ab-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:57 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 Sep 28 15:18:57 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65" returned: 0 in 0.450s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65 Sep 28 15:18:57 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-32bb1fe0-d18c-40fd-a791-21a812a58f65" returned: 0 in 0.253s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-quobyte-32bb1fe0-d18c-40fd-a791-21a812a58f65" released by "delete_volume" :: held 0.818s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Created reservations ['445b38c2-6360-4f7c-b4f6-c1f7a283ddb1', 'd6ed11ed-95e8-4f1d-867c-49aa67cf9609', '84bd134c-0605-4522-ba22-b03f525ebf48', '76542288-8002-4495-b3ba-5b57aa62b34c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:18:57 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-d4e7c33d-4eae-452e-a786-130b70992864 req-50106fae-a560-46ba-bdef-b305cc5a7f8d tempest-TestStampPattern-722328113 None] Terminate volume connection completed successfully. Sep 28 15:18:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-d4e7c33d-4eae-452e-a786-130b70992864 req-50106fae-a560-46ba-bdef-b305cc5a7f8d tempest-TestStampPattern-722328113 None] Deleting attachment 2cfcc4f6-37be-49ce-a534-305320b09b05. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:18:58 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.323s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:58 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Deleted volume successfully. Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c569f32a-0813-428a-98b3-77a7e81592a5 tempest-CinderUnicodeTest-1847883685 None] Lock "cinder-32bb1fe0-d18c-40fd-a791-21a812a58f65-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Creating offline snapshot 26bd41ff-2a85-48b0-841a-79445389154e of volume 700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[638938dd-2719-44ed-9674-62f814ec5a62]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:58 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd Sep 28 15:18:58 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e 1G Sep 28 15:18:59 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e 1G" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e Sep 28 15:18:59 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e" returned: 0 in 0.356s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e is being set with open permissions: ugo+rw Sep 28 15:18:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e Sep 28 15:19:00 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info Sep 28 15:19:00 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info is being set with open permissions: ugo+rw Sep 28 15:19:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info Sep 28 15:19:00 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.info" returned: 0 in 0.254s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d3fa0f0f-0a5a-4b45-ad90-b8028ada3e5f tempest-TestStampPattern-722328113 None] Create snapshot completed successfully Sep 28 15:19:09 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Flow 'volume_create_manager' (7a1ca146-a049-4789-84ce-db6f90d7b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a31973-b6a4-4b7a-8e0f-daec0e84f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a31973-b6a4-4b7a-8e0f-daec0e84f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1251305224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d724f53f-95d2-48e8-9cbb-560dc73d3d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d856d758c34081842bb3334073d943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26bd41ff-2a85-48b0-841a-79445389154e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:10Z,use_quota=True,user_id='00b77dee1e9747cd8c578dd508091ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838c9553-9d7f-493f-998a-5bcb2a0e21d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838c9553-9d7f-493f-998a-5bcb2a0e21d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90fab76-0cab-4976-9455-4053b09914d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90fab76-0cab-4976-9455-4053b09914d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd724f53f-95d2-48e8-9cbb-560dc73d3d13', 'volume_name': 'volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13', 'volume_size': 1, 'snapshot_id': '26bd41ff-2a85-48b0-841a-79445389154e'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed32f16-5e44-4609-9fb9-3c67a377dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed32f16-5e44-4609-9fb9-3c67a377dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a872bd7-32e6-467e-8df5-e0538e8635a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Volume d724f53f-95d2-48e8-9cbb-560dc73d3d13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13', 'volume_size': 1, 'snapshot_id': '26bd41ff-2a85-48b0-841a-79445389154e'} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-quobyte-26bd41ff-2a85-48b0-841a-79445389154e-d724f53f-95d2-48e8-9cbb-560dc73d3d13" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-26bd41ff-2a85-48b0-841a-79445389154e-d724f53f-95d2-48e8-9cbb-560dc73d3d13" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Creating volume d724f53f-95d2-48e8-9cbb-560dc73d3d13 from snapshot 26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-quobyte-d724f53f-95d2-48e8-9cbb-560dc73d3d13" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-d724f53f-95d2-48e8-9cbb-560dc73d3d13" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] snapshot: 26bd41ff-2a85-48b0-841a-79445389154e, volume: d724f53f-95d2-48e8-9cbb-560dc73d3d13, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f88056c-5e15-4692-af08-7d9a8ef4150f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:10 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e Sep 28 15:19:10 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:10 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e" returned: 0 in 0.427s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7276647-08d9-4a9c-98fa-f463ccb52c01]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:10 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd Sep 28 15:19:10 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:11 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:19:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:19:11 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:19:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:11 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 Sep 28 15:19:11 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=72,cinder:INSERT=20,cinder:SELECT=71,cinder:DELETE=4 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:20 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13" returned: 0 in 8.911s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:19:20 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Converted 1024.00 MB image at 114.91 MB/s Sep 28 15:19:20 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 is being set with open permissions: ugo+rw Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:20 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 Sep 28 15:19:20 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=60,cinder:UPDATE=66,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:20 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13" returned: 0 in 0.293s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-d724f53f-95d2-48e8-9cbb-560dc73d3d13" released by "_copy_volume_from_snapshot" :: held 10.231s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-26bd41ff-2a85-48b0-841a-79445389154e-d724f53f-95d2-48e8-9cbb-560dc73d3d13" released by "_create_volume_from_snapshot" :: held 10.318s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.337s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a872bd7-32e6-467e-8df5-e0538e8635a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13', 'volume_size': 1, 'snapshot_id': '26bd41ff-2a85-48b0-841a-79445389154e'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60091e6a-cee6-4e39-8ddb-d311aab190ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Volume volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 (d724f53f-95d2-48e8-9cbb-560dc73d3d13): created successfully Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60091e6a-cee6-4e39-8ddb-d311aab190ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Flow 'volume_create_manager' (7a1ca146-a049-4789-84ce-db6f90d7b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-40f5ba61-ab06-40c7-b064-7e90632a4526 tempest-TestStampPattern-722328113 None] Created volume successfully. Sep 28 15:19:30 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:30 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:37 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:19:37 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:37 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.257s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:19:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:19:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:45 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-32ac9b2e-fc27-4e7e-96d1-5ad743c6ad53 req-bee36863-c7f3-4fc5-8bb8-600c49516be9 tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-32ac9b2e-fc27-4e7e-96d1-5ad743c6ad53 req-bee36863-c7f3-4fc5-8bb8-600c49516be9 tempest-TestStampPattern-722328113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [req-32ac9b2e-fc27-4e7e-96d1-5ad743c6ad53 req-bee36863-c7f3-4fc5-8bb8-600c49516be9 tempest-TestStampPattern-722328113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-32ac9b2e-fc27-4e7e-96d1-5ad743c6ad53 req-bee36863-c7f3-4fc5-8bb8-600c49516be9 tempest-TestStampPattern-722328113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794', 'name': 'volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2330abb9-2c50-49b6-a298-2e7c1557c4a4', 'enforce_multipath': True} {{(pid=87124) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:20:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-32ac9b2e-fc27-4e7e-96d1-5ad743c6ad53 req-bee36863-c7f3-4fc5-8bb8-600c49516be9 tempest-TestStampPattern-722328113 None] attachment_update completed successfully. Sep 28 15:20:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [req-e74b8120-5d35-41f0-baeb-4de75967e9c5 req-49b8525e-1911-48c0-aafe-a6ffc4e92c3e tempest-TestStampPattern-722328113 None] Terminate volume connection completed successfully. Sep 28 15:20:05 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [req-e74b8120-5d35-41f0-baeb-4de75967e9c5 req-49b8525e-1911-48c0-aafe-a6ffc4e92c3e tempest-TestStampPattern-722328113 None] Deleting attachment 2330abb9-2c50-49b6-a298-2e7c1557c4a4. {{(pid=87124) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:20:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-d724f53f-95d2-48e8-9cbb-560dc73d3d13-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Lock "cinder-d724f53f-95d2-48e8-9cbb-560dc73d3d13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-quobyte-d724f53f-95d2-48e8-9cbb-560dc73d3d13" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-d724f53f-95d2-48e8-9cbb-560dc73d3d13" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:09 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[599cd612-17ff-4d74-997f-66d30bd060fc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:10 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 Sep 28 15:20:10 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:10 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13" returned: 0 in 0.381s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:10 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13 Sep 28 15:20:10 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:10 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d724f53f-95d2-48e8-9cbb-560dc73d3d13" returned: 0 in 0.279s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-d724f53f-95d2-48e8-9cbb-560dc73d3d13" released by "delete_volume" :: held 0.718s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Created reservations ['f0daf75d-9c52-4805-9630-aa0feacdf1a1', 'e7b036de-b28f-48d6-a3af-41209ca8e9a0', '1d399016-2f4f-4799-9637-a93217e244be', '2aca2a08-ff8b-440b-8dd6-08d327a34d51'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:10 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:10 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:11 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.269s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Deleted volume successfully. Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2a3f67ce-7431-4ba4-9d35-d3f903b64b2e tempest-TestStampPattern-722328113 None] Lock "cinder-d724f53f-95d2-48e8-9cbb-560dc73d3d13-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-26bd41ff-2a85-48b0-841a-79445389154e-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Lock "cinder-26bd41ff-2a85-48b0-841a-79445389154e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-quobyte-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-quobyte-26bd41ff-2a85-48b0-841a-79445389154e" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-26bd41ff-2a85-48b0-841a-79445389154e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Deleting offline snapshot 26bd41ff-2a85-48b0-841a-79445389154e of volume 700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] snapshot_file for this snap is: volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd56c1f5-bc24-430c-96e5-41e696d18302]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:11 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e Sep 28 15:20:11 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:11 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1cba1-c1f5-4b9f-b787-9ffc1e020812]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:11 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd Sep 28 15:20:11 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:12 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" returned: 0 in 0.562s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:12 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e Sep 28 15:20:12 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:12 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e" returned: 0 in 0.392s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:12 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e Sep 28 15:20:12 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:13 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd.26bd41ff-2a85-48b0-841a-79445389154e" returned: 0 in 0.270s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-26bd41ff-2a85-48b0-841a-79445389154e" released by "_delete_snapshot" :: held 1.733s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" released by "delete_snapshot" :: held 1.756s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:13 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Created reservations ['aea3c042-f5be-44b6-a813-a112698ee8aa', '945cbd97-870f-4aef-abd1-f53bd318d741', '9a52cf8d-4af5-4b18-829e-fe16a3661fd9', 'a4a73352-73c7-4fb5-94c1-324a7a35f2fe'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Delete snapshot completed successfully. Sep 28 15:20:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d46b50b5-244f-4376-ab81-77ba1344b13a tempest-TestStampPattern-722328113 None] Lock "cinder-26bd41ff-2a85-48b0-841a-79445389154e-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-700e3ba6-42fe-4127-bf86-feb02fc0d1bd-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Lock "cinder-700e3ba6-42fe-4127-bf86-feb02fc0d1bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Acquiring lock "cinder-quobyte-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[905e7cf9-b5b6-4283-ae8e-faaa47bed8b0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:17 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd Sep 28 15:20:17 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:17 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" returned: 0 in 0.404s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:17 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd Sep 28 15:20:17 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:18 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" returned: 0 in 0.286s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Lock "cinder-quobyte-700e3ba6-42fe-4127-bf86-feb02fc0d1bd" released by "delete_volume" :: held 0.765s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Created reservations ['10d2676e-c84a-4b51-ace9-7346f94c50a2', 'dd0fe8b5-27f5-4eed-a348-1f703225902b', '2edbdd6f-2746-4fa5-99c0-ebfcecc9f235', '9ab5d009-5827-4463-9ef8-642aeb9da61d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:18 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:18 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:18 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.246s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Deleted volume successfully. Sep 28 15:20:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2be9e88-a314-4be5-9303-318632e2b65c tempest-TestStampPattern-722328113 None] Lock "cinder-700e3ba6-42fe-4127-bf86-feb02fc0d1bd-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:28 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:28 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=20,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (4ddbe743-8daf-48a4-9afa-d8390301f59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675b0d78-5dd7-45d8-bd14-4f30256ac573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675b0d78-5dd7-45d8-bd14-4f30256ac573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-666845639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251234cf-db8c-43df-adda-55a7f93384ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:31Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6f9c8b-911c-4885-b17b-b1f01f79556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6f9c8b-911c-4885-b17b-b1f01f79556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33129ed-c576-4e0f-a6b6-5d26150f522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33129ed-c576-4e0f-a6b6-5d26150f522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251234cf-db8c-43df-adda-55a7f93384ad', 'volume_name': 'volume-251234cf-db8c-43df-adda-55a7f93384ad', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28464686-a762-48bb-a51a-307d5f0b0530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28464686-a762-48bb-a51a-307d5f0b0530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ef8a51-8986-49d5-8adf-f4a9e51e1987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Volume 251234cf-db8c-43df-adda-55a7f93384ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251234cf-db8c-43df-adda-55a7f93384ad', 'volume_size': 1} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-666845639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251234cf-db8c-43df-adda-55a7f93384ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:31Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Creating volume 251234cf-db8c-43df-adda-55a7f93384ad {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:31 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:31 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad 1073741824 Sep 28 15:20:31 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (ccb01cf4-98f4-4e74-a128-4a93a816a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d222da-e481-4598-be47-f3ccc6c3a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d222da-e481-4598-be47-f3ccc6c3a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827239093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:32Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a4e0d-2c90-4deb-a847-302e2d95b925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a4e0d-2c90-4deb-a847-302e2d95b925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae01f109-ccaa-481c-b14a-06f0cb911954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae01f109-ccaa-481c-b14a-06f0cb911954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1', 'volume_name': 'volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd23a0b-78b3-4c60-a3c5-28837e0b79b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd23a0b-78b3-4c60-a3c5-28837e0b79b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a0a017-72c6-4c27-91e5-28294ee3b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Volume a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1', 'volume_size': 1} Sep 28 15:20:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:32 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad 1073741824" returned: 0 in 0.559s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:32 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad Sep 28 15:20:32 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (d2d700e0-9338-4153-89c9-d29a739a61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61423164-fe04-4a12-bb3c-9a95188c01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61423164-fe04-4a12-bb3c-9a95188c01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175671404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e4dc86-5b24-4e8a-9876-0ef3861288cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:32Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e8e9c1-8fe2-45de-9f34-da49b4b0fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e8e9c1-8fe2-45de-9f34-da49b4b0fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e82e99-4af8-444c-a65c-37543f34afae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e82e99-4af8-444c-a65c-37543f34afae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e4dc86-5b24-4e8a-9876-0ef3861288cb', 'volume_name': 'volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be9cc28-ca06-4d6e-9528-7f267e2a8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be9cc28-ca06-4d6e-9528-7f267e2a8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5860b8-2edd-45bf-ba7e-42f322140a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Volume 82e4dc86-5b24-4e8a-9876-0ef3861288cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb', 'volume_size': 1} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:32 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad" returned: 0 in 0.308s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827239093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:32Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Creating volume a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:32 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ef8a51-8986-49d5-8adf-f4a9e51e1987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251234cf-db8c-43df-adda-55a7f93384ad', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081c6970-9092-4505-a45e-e9f5fbda0bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 1073741824 Sep 28 15:20:32 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Volume volume-251234cf-db8c-43df-adda-55a7f93384ad (251234cf-db8c-43df-adda-55a7f93384ad): created successfully Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081c6970-9092-4505-a45e-e9f5fbda0bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (4ddbe743-8daf-48a4-9afa-d8390301f59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:32 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0d0ac3bb-388c-4ed9-a297-bd2c18b42fa7 tempest-CreateVolumesFromImageTest-1002398411 None] Created volume successfully. Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (aa39ae4f-c208-489a-a6c4-6dd08100a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d2ca2a-2348-4e15-a956-72a56b3fc03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d2ca2a-2348-4e15-a956-72a56b3fc03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724330829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c9d070-90f0-461b-9649-0792d0c215a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:33Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900fcec9-9ec3-4d0f-ba06-a263fadabe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900fcec9-9ec3-4d0f-ba06-a263fadabe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cd0175-42bf-4277-a256-e71960c3fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cd0175-42bf-4277-a256-e71960c3fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c9d070-90f0-461b-9649-0792d0c215a6', 'volume_name': 'volume-e6c9d070-90f0-461b-9649-0792d0c215a6', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3dc52b-f37f-4a7b-8b70-f2c7ad835198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3dc52b-f37f-4a7b-8b70-f2c7ad835198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801236cd-cc50-46d7-bc37-ead6089cceea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Volume e6c9d070-90f0-461b-9649-0792d0c215a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c9d070-90f0-461b-9649-0792d0c215a6', 'volume_size': 1} Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:32 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 1073741824" returned: 0 in 0.574s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:33 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 Sep 28 15:20:33 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (57d692ce-17e9-4bb8-9d6e-39dca0587c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7032af69-097a-44cc-b532-117601f694b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7032af69-097a-44cc-b532-117601f694b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2025086549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc468f4-50c8-4603-8c91-e65cb535fefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:33Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee451bbc-46a3-48b8-887e-50f42d1bc7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee451bbc-46a3-48b8-887e-50f42d1bc7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5d23cf-2729-41a3-a61d-d00084d489db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5d23cf-2729-41a3-a61d-d00084d489db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc468f4-50c8-4603-8c91-e65cb535fefe', 'volume_name': 'volume-7dc468f4-50c8-4603-8c91-e65cb535fefe', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e7f229-8d08-4a91-9826-23e854b48939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e7f229-8d08-4a91-9826-23e854b48939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84a1470-cbd3-467f-85db-a347afae1d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Volume 7dc468f4-50c8-4603-8c91-e65cb535fefe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc468f4-50c8-4603-8c91-e65cb535fefe', 'volume_size': 1} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175671404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e4dc86-5b24-4e8a-9876-0ef3861288cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:32Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Creating volume 82e4dc86-5b24-4e8a-9876-0ef3861288cb {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:33 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a0a017-72c6-4c27-91e5-28294ee3b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb 1073741824 Sep 28 15:20:33 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f24468c-8a33-4c0c-ba1f-bf9951f25196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Volume volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 (a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1): created successfully Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f24468c-8a33-4c0c-ba1f-bf9951f25196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (ccb01cf4-98f4-4e74-a128-4a93a816a190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-81213de2-5e13-4331-b6e0-1805ce55b2ea tempest-CreateVolumesFromImageTest-1002398411 None] Created volume successfully. Sep 28 15:20:33 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb 1073741824" returned: 0 in 0.424s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:33 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb Sep 28 15:20:33 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:33 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb" returned: 0 in 0.233s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724330829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c9d070-90f0-461b-9649-0792d0c215a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:33Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Creating volume e6c9d070-90f0-461b-9649-0792d0c215a6 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:34 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5860b8-2edd-45bf-ba7e-42f322140a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:34 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 1073741824 Sep 28 15:20:34 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60805c3-9a59-4f17-a596-a57bd662cca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:34 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Volume volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb (82e4dc86-5b24-4e8a-9876-0ef3861288cb): created successfully Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60805c3-9a59-4f17-a596-a57bd662cca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (d2d700e0-9338-4153-89c9-d29a739a61bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6adec8fc-153a-4638-8be1-71240de67f3f tempest-CreateVolumesFromImageTest-1002398411 None] Created volume successfully. Sep 28 15:20:34 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 1073741824" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:34 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 Sep 28 15:20:34 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6" returned: 0 in 0.255s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2025086549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc468f4-50c8-4603-8c91-e65cb535fefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd8b643586a490cb6b1195c95a2141d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:33Z,use_quota=True,user_id='c4660dccee7145d3bbe7f5265f2abe86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Creating volume 7dc468f4-50c8-4603-8c91-e65cb535fefe {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:34 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:34 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe 1073741824 Sep 28 15:20:34 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801236cd-cc50-46d7-bc37-ead6089cceea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c9d070-90f0-461b-9649-0792d0c215a6', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ea0fe6-ecba-4248-820f-1d29c11147da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:34 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Volume volume-e6c9d070-90f0-461b-9649-0792d0c215a6 (e6c9d070-90f0-461b-9649-0792d0c215a6): created successfully Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ea0fe6-ecba-4248-820f-1d29c11147da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:34 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (aa39ae4f-c208-489a-a6c4-6dd08100a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5b2b7b4f-7f71-4d76-b2c2-b996605af94e tempest-CreateVolumesFromImageTest-1002398411 None] Created volume successfully. Sep 28 15:20:35 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe 1073741824" returned: 0 in 0.454s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:35 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe Sep 28 15:20:35 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:35 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe" returned: 0 in 0.249s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84a1470-cbd3-467f-85db-a347afae1d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc468f4-50c8-4603-8c91-e65cb535fefe', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489e7a21-3b97-4cdf-9ccf-543c4ce0324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:35 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Volume volume-7dc468f4-50c8-4603-8c91-e65cb535fefe (7dc468f4-50c8-4603-8c91-e65cb535fefe): created successfully Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489e7a21-3b97-4cdf-9ccf-543c4ce0324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Flow 'volume_create_manager' (57d692ce-17e9-4bb8-9d6e-39dca0587c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-175c4b80-b11f-4354-a667-5f0c7399ef4e tempest-CreateVolumesFromImageTest-1002398411 None] Created volume successfully. Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-7dc468f4-50c8-4603-8c91-e65cb535fefe-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-7dc468f4-50c8-4603-8c91-e65cb535fefe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-quobyte-7dc468f4-50c8-4603-8c91-e65cb535fefe" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-7dc468f4-50c8-4603-8c91-e65cb535fefe" acquired by "delete_volume" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9e1b34-5566-4506-a8a0-e13253f87c42]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:36 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe Sep 28 15:20:36 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:36 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe" returned: 0 in 0.382s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:37 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe Sep 28 15:20:37 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:37 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-7dc468f4-50c8-4603-8c91-e65cb535fefe" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-7dc468f4-50c8-4603-8c91-e65cb535fefe" released by "delete_volume" :: held 0.693s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Created reservations ['bf888183-46f3-485b-b1e7-a585e2752261', '178b2304-aec3-483e-a485-5d37af98b235', '4c8b8970-7272-4403-9281-7943c23a0c8f', 'a5eeb605-d1ca-4f2d-bb39-33c7f8534795'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:37 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:37 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:37 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:37 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:37 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.308s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-e6c9d070-90f0-461b-9649-0792d0c215a6-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:37 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-e6c9d070-90f0-461b-9649-0792d0c215a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.324s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Deleted volume successfully. Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4e91be4e-dfc7-481a-b8c2-7cc1633816b5 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-7dc468f4-50c8-4603-8c91-e65cb535fefe-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-quobyte-e6c9d070-90f0-461b-9649-0792d0c215a6" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-e6c9d070-90f0-461b-9649-0792d0c215a6" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6ef033-48d9-4fcc-a721-5990cab3c793]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:38 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 Sep 28 15:20:38 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:38 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6" returned: 0 in 0.405s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:38 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6 Sep 28 15:20:38 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:38 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6c9d070-90f0-461b-9649-0792d0c215a6" returned: 0 in 0.252s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-e6c9d070-90f0-461b-9649-0792d0c215a6" released by "delete_volume" :: held 0.711s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Created reservations ['0e645073-5ba3-4f3a-a416-1e96e0a68ddc', 'def4c33e-cbbf-47a9-84b7-2bc83a86e75e', 'bd012f88-7259-4b5a-b89f-84bb88b348aa', '5fa1859a-4a8e-40cd-bb6c-93792c7b5399'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:38 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:38 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-82e4dc86-5b24-4e8a-9876-0ef3861288cb-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-82e4dc86-5b24-4e8a-9876-0ef3861288cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-quobyte-82e4dc86-5b24-4e8a-9876-0ef3861288cb" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:38 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.291s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:39 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Deleted volume successfully. Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-82e4dc86-5b24-4e8a-9876-0ef3861288cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e80cbf-30c4-4f2e-aff6-732866969dc2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4b5a2cbb-6652-4370-9482-d4b8d4936436 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-e6c9d070-90f0-461b-9649-0792d0c215a6-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:39 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb Sep 28 15:20:39 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:39 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb" returned: 0 in 0.381s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:39 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb Sep 28 15:20:39 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:39 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-82e4dc86-5b24-4e8a-9876-0ef3861288cb" returned: 0 in 0.270s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-82e4dc86-5b24-4e8a-9876-0ef3861288cb" released by "delete_volume" :: held 0.702s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Created reservations ['1ac2a84d-d67a-43e6-9010-8e4ae7568f69', '73547e3d-9dd3-41f3-991a-d15658e2fdde', '7cf2b6e0-3c23-4e36-8390-9eba384de34a', 'd29d90ae-a121-45ec-ac2c-a7a6bc28feb8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:39 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:39 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:40 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.290s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Deleted volume successfully. Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf16312-13f0-4991-bb13-b18c40cb9df9 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-82e4dc86-5b24-4e8a-9876-0ef3861288cb-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-quobyte-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9c795b-ff43-49d7-a685-ffe761604ad8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:40 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 Sep 28 15:20:40 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:40 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1" returned: 0 in 0.358s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:40 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1 Sep 28 15:20:40 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:40 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1" returned: 0 in 0.254s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1" released by "delete_volume" :: held 0.655s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Created reservations ['5417754a-afe2-4ea0-a3db-c2353fef3d20', '95776a5a-d7a1-43e8-b8f3-35e2e9befac4', '578f61f7-9e85-47a7-ac48-f01c68b933a9', '1d8e2593-66b1-4499-a928-f4ee38c7e5a9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:41 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:41 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:41 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:41 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Deleted volume successfully. Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a1c414dc-9298-494f-81d8-be3b59c90133 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-a1d0fb73-8dc0-4cfc-9f8b-5dd4abe2a0e1-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-251234cf-db8c-43df-adda-55a7f93384ad-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-251234cf-db8c-43df-adda-55a7f93384ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "cinder-quobyte-251234cf-db8c-43df-adda-55a7f93384ad" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-251234cf-db8c-43df-adda-55a7f93384ad" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[57238328-8e56-4c61-959b-c93c8a37b11d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:41 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad Sep 28 15:20:41 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:41 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad" returned: 0 in 0.389s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:41 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad Sep 28 15:20:41 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:42 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-251234cf-db8c-43df-adda-55a7f93384ad" returned: 0 in 0.263s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-quobyte-251234cf-db8c-43df-adda-55a7f93384ad" released by "delete_volume" :: held 0.717s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Created reservations ['712e81ab-9a19-48c4-a116-c5ba233057bc', '1649b25f-6e04-4ae0-9c64-bd5a0ffd49e9', 'c684b784-3579-44e7-8c6f-58f5e4dcc930', 'c96c4935-9721-40a5-ab1b-361dc18c0098'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:42 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:20:42 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:42 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.280s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Deleted volume successfully. Sep 28 15:20:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d097146d-537b-4644-956d-b81bfa5aced6 tempest-CreateVolumesFromImageTest-1002398411 None] Lock "cinder-251234cf-db8c-43df-adda-55a7f93384ad-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Flow 'volume_create_manager' (3e42d9fb-2870-410b-ac64-140f5456db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bff80e7-abc2-4121-a59f-2349c10e1d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bff80e7-abc2-4121-a59f-2349c10e1d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1233258720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db520786-c058-4738-a48b-d1c856af87e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6b0dc3274a492ab60cff352e66402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:46Z,use_quota=True,user_id='d7ff345d7a424b7b9fc87014e8608f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9d588e-894f-4532-9013-ff90fd740abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9d588e-894f-4532-9013-ff90fd740abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f36ce9-2239-47ab-9f54-1477476c4b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f36ce9-2239-47ab-9f54-1477476c4b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db520786-c058-4738-a48b-d1c856af87e2', 'volume_name': 'volume-db520786-c058-4738-a48b-d1c856af87e2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83389ca1-7773-4146-99c3-c6fa5cdf7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83389ca1-7773-4146-99c3-c6fa5cdf7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ae8b9a-eee8-43e7-aaa9-a9ac17938a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Volume db520786-c058-4738-a48b-d1c856af87e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db520786-c058-4738-a48b-d1c856af87e2', 'volume_size': 1} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1233258720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db520786-c058-4738-a48b-d1c856af87e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6b0dc3274a492ab60cff352e66402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:46Z,use_quota=True,user_id='d7ff345d7a424b7b9fc87014e8608f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Creating volume db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:45 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:20:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:45 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 1073741824 Sep 28 15:20:45 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:46 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 1073741824" returned: 0 in 0.493s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:46 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 Sep 28 15:20:46 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:46 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2" returned: 0 in 0.304s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ae8b9a-eee8-43e7-aaa9-a9ac17938a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db520786-c058-4738-a48b-d1c856af87e2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551e50f-f457-4fb9-a73d-a15fe82a7179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Volume volume-db520786-c058-4738-a48b-d1c856af87e2 (db520786-c058-4738-a48b-d1c856af87e2): created successfully Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551e50f-f457-4fb9-a73d-a15fe82a7179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Flow 'volume_create_manager' (3e42d9fb-2870-410b-ac64-140f5456db50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:46 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-31c9377d-6913-41d0-895c-21c960b148b4 tempest-VolumeDependencyTests-783312542 None] Created volume successfully. Sep 28 15:20:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Creating offline snapshot 36cf1e9c-00e7-4f65-84ea-238beefec967 of volume db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:20:47 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae76ad0-7597-46dc-b7f1-613a9960d090]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 Sep 28 15:20:48 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:48 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2" returned: 0 in 0.415s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 1G Sep 28 15:20:48 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:48 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 1G" returned: 0 in 0.503s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db520786-c058-4738-a48b-d1c856af87e2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db520786-c058-4738-a48b-d1c856af87e2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 Sep 28 15:20:48 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db520786-c058-4738-a48b-d1c856af87e2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967" returned: 0 in 0.302s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:49 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 is being set with open permissions: ugo+rw Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 Sep 28 15:20:49 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967" returned: 0 in 0.255s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info Sep 28 15:20:49 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info" returned: 0 in 0.254s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:49 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info is being set with open permissions: ugo+rw Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info Sep 28 15:20:49 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.info" returned: 0 in 0.248s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1fc1627a-830e-4cbc-8647-f8a32746851b tempest-VolumeDependencyTests-783312542 None] Create snapshot completed successfully Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Flow 'volume_create_manager' (c8c44deb-63dc-4ac7-a8c1-0d07f19789bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d108c18-8a40-4e93-8c7b-0a59a865baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d108c18-8a40-4e93-8c7b-0a59a865baad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-635514140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4199de-b007-40a1-8d99-b4675edc4187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6b0dc3274a492ab60cff352e66402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36cf1e9c-00e7-4f65-84ea-238beefec967,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:54Z,use_quota=True,user_id='d7ff345d7a424b7b9fc87014e8608f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06031771-7184-43f6-9d63-b31be077b5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06031771-7184-43f6-9d63-b31be077b5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51763f3e-e7c7-4b41-a235-679cd8fae550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51763f3e-e7c7-4b41-a235-679cd8fae550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c4199de-b007-40a1-8d99-b4675edc4187', 'volume_name': 'volume-6c4199de-b007-40a1-8d99-b4675edc4187', 'volume_size': 1, 'snapshot_id': '36cf1e9c-00e7-4f65-84ea-238beefec967'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd1552d-a068-403b-b36b-28c1b8f0cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd1552d-a068-403b-b36b-28c1b8f0cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183efc84-18e7-483b-9a39-8dd5f953f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Volume 6c4199de-b007-40a1-8d99-b4675edc4187: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c4199de-b007-40a1-8d99-b4675edc4187', 'volume_size': 1, 'snapshot_id': '36cf1e9c-00e7-4f65-84ea-238beefec967'} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-quobyte-36cf1e9c-00e7-4f65-84ea-238beefec967-6c4199de-b007-40a1-8d99-b4675edc4187" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-36cf1e9c-00e7-4f65-84ea-238beefec967-6c4199de-b007-40a1-8d99-b4675edc4187" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Creating volume 6c4199de-b007-40a1-8d99-b4675edc4187 from snapshot 36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-quobyte-6c4199de-b007-40a1-8d99-b4675edc4187" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-6c4199de-b007-40a1-8d99-b4675edc4187" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] snapshot: 36cf1e9c-00e7-4f65-84ea-238beefec967, volume: 6c4199de-b007-40a1-8d99-b4675edc4187, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52c66de-75af-4d51-b20e-9a331a8ea009]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:55 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 Sep 28 15:20:55 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:55 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967" returned: 0 in 0.385s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db520786-c058-4738-a48b-d1c856af87e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073b670-4425-4b1f-894b-5e2602110de8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 Sep 28 15:20:56 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:56 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2" returned: 0 in 0.401s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:20:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:20:56 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:20:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 Sep 28 15:20:56 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:02 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187" returned: 0 in 6.137s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:21:02 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Converted 1024.00 MB image at 166.81 MB/s Sep 28 15:21:02 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 is being set with open permissions: ugo+rw Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:02 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 Sep 28 15:21:02 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:02 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187" returned: 0 in 0.270s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-6c4199de-b007-40a1-8d99-b4675edc4187" released by "_copy_volume_from_snapshot" :: held 7.307s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-36cf1e9c-00e7-4f65-84ea-238beefec967-6c4199de-b007-40a1-8d99-b4675edc4187" released by "_create_volume_from_snapshot" :: held 7.372s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.389s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183efc84-18e7-483b-9a39-8dd5f953f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4199de-b007-40a1-8d99-b4675edc4187', 'volume_size': 1, 'snapshot_id': '36cf1e9c-00e7-4f65-84ea-238beefec967'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f65fc1-ebfe-49be-9879-9ba33c9c9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Volume volume-6c4199de-b007-40a1-8d99-b4675edc4187 (6c4199de-b007-40a1-8d99-b4675edc4187): created successfully Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f65fc1-ebfe-49be-9879-9ba33c9c9368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Flow 'volume_create_manager' (c8c44deb-63dc-4ac7-a8c1-0d07f19789bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a03beac5-15ca-4bad-839f-a366bce83dec tempest-VolumeDependencyTests-783312542 None] Created volume successfully. Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-36cf1e9c-00e7-4f65-84ea-238beefec967-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Lock "cinder-36cf1e9c-00e7-4f65-84ea-238beefec967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-quobyte-db520786-c058-4738-a48b-d1c856af87e2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-db520786-c058-4738-a48b-d1c856af87e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-quobyte-36cf1e9c-00e7-4f65-84ea-238beefec967" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-36cf1e9c-00e7-4f65-84ea-238beefec967" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Deleting offline snapshot 36cf1e9c-00e7-4f65-84ea-238beefec967 of volume db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] snapshot_file for this snap is: volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ecedb-77e8-4283-8db0-c4c23310715c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:03 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 Sep 28 15:21:03 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:03 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db520786-c058-4738-a48b-d1c856af87e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4da181-8aef-40ba-a30c-2ea7cfe198f7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:04 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 Sep 28 15:21:04 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:04 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2" returned: 0 in 0.620s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:04 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 Sep 28 15:21:04 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:04 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967" returned: 0 in 0.374s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:04 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967 Sep 28 15:21:04 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:05 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2.36cf1e9c-00e7-4f65-84ea-238beefec967" returned: 0 in 0.242s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-36cf1e9c-00e7-4f65-84ea-238beefec967" released by "_delete_snapshot" :: held 1.777s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-db520786-c058-4738-a48b-d1c856af87e2" released by "delete_snapshot" :: held 1.802s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Created reservations ['2a9193a1-38e4-4eee-8886-dd712099fe40', '6c03570b-d3ed-404c-9df0-d20176d154e2', 'dcb390d4-f428-485d-820e-2a9bb33a0f49', 'a2956351-3242-4bfd-8b9f-f818d48fb206'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Delete snapshot completed successfully. Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4213e9d8-db07-4467-89c6-ab0c64fed5ba tempest-VolumeDependencyTests-783312542 None] Lock "cinder-36cf1e9c-00e7-4f65-84ea-238beefec967-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-db520786-c058-4738-a48b-d1c856af87e2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Lock "cinder-db520786-c058-4738-a48b-d1c856af87e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-quobyte-db520786-c058-4738-a48b-d1c856af87e2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-db520786-c058-4738-a48b-d1c856af87e2" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23785e5-4068-4dc3-85be-41ebd6fd648e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:05 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 Sep 28 15:21:05 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2" returned: 0 in 0.382s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2 Sep 28 15:21:06 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-db520786-c058-4738-a48b-d1c856af87e2" returned: 0 in 0.279s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-db520786-c058-4738-a48b-d1c856af87e2" released by "delete_volume" :: held 0.726s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Created reservations ['5fa4e411-bcf7-4d45-b82d-2c73baa387ed', '2eeb0173-a133-403a-b307-93c7e29d7eff', '9bc68431-bb48-4cdf-a52b-c3f785ed7aca', 'da45e489-5a8d-4873-830d-dfcb3d4e5092'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:06 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-6c4199de-b007-40a1-8d99-b4675edc4187-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.247s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Deleted volume successfully. Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Lock "cinder-6c4199de-b007-40a1-8d99-b4675edc4187-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c136237-66b3-4233-b1b7-1041704b71ee tempest-VolumeDependencyTests-783312542 None] Lock "cinder-db520786-c058-4738-a48b-d1c856af87e2-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Acquiring lock "cinder-quobyte-6c4199de-b007-40a1-8d99-b4675edc4187" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-6c4199de-b007-40a1-8d99-b4675edc4187" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[293a7d31-38c4-406f-9a50-e4e30f7c4243]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 Sep 28 15:21:06 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:07 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:07 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187 Sep 28 15:21:07 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:07 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6c4199de-b007-40a1-8d99-b4675edc4187" returned: 0 in 0.260s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Lock "cinder-quobyte-6c4199de-b007-40a1-8d99-b4675edc4187" released by "delete_volume" :: held 0.666s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Created reservations ['1cf92675-e247-4f24-a960-272daadbe65d', '350dc784-8954-404b-ab36-9ebdef462297', '15ddeb68-c117-4be9-ae37-d8bb65f213e7', '46775512-2eed-41c8-837c-9854d6a36294'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:07 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:07 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:07 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.239s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Deleted volume successfully. Sep 28 15:21:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79577065-c242-4382-a796-4de05633f8e5 tempest-VolumeDependencyTests-783312542 None] Lock "cinder-6c4199de-b007-40a1-8d99-b4675edc4187-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (e14d2dea-8882-44e4-80b7-f8aa3a42e841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c164aca3-3bc2-4301-9fc0-7ba29a905415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c164aca3-3bc2-4301-9fc0-7ba29a905415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792721185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0044f24-72f5-4c14-af2c-1fa0b4a84272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:16Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e958ec1-a5c6-4cab-8e2e-4947ce7378b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e958ec1-a5c6-4cab-8e2e-4947ce7378b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844781d0-207c-4fed-94e2-8ffb11afc6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844781d0-207c-4fed-94e2-8ffb11afc6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0044f24-72f5-4c14-af2c-1fa0b4a84272', 'volume_name': 'volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d723e79-7bc3-4d53-9cce-4640329ed5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d723e79-7bc3-4d53-9cce-4640329ed5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9460fcee-5388-4382-a8de-68527cb8135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:15 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Volume e0044f24-72f5-4c14-af2c-1fa0b4a84272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272', 'volume_size': 1} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792721185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0044f24-72f5-4c14-af2c-1fa0b4a84272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:16Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Creating volume e0044f24-72f5-4c14-af2c-1fa0b4a84272 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:15 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:15 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 1073741824 Sep 28 15:21:15 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:16 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 1073741824" returned: 0 in 0.430s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:16 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 Sep 28 15:21:16 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:16 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272" returned: 0 in 0.245s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9460fcee-5388-4382-a8de-68527cb8135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b500190-7306-4d76-8911-c7b6834d2286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:16 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Volume volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 (e0044f24-72f5-4c14-af2c-1fa0b4a84272): created successfully Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b500190-7306-4d76-8911-c7b6834d2286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (e14d2dea-8882-44e4-80b7-f8aa3a42e841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f0de351e-7f94-4e94-a310-5974f9ef2f4c tempest-ProjectReaderTests-1871258678 None] Created volume successfully. Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-e0044f24-72f5-4c14-af2c-1fa0b4a84272-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-e0044f24-72f5-4c14-af2c-1fa0b4a84272-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-quobyte-e0044f24-72f5-4c14-af2c-1fa0b4a84272" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-e0044f24-72f5-4c14-af2c-1fa0b4a84272" acquired by "delete_volume" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae8798-caa2-4ed1-adda-bf3d29f67d48]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:17 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 Sep 28 15:21:17 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:17 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272" returned: 0 in 0.358s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:17 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272 Sep 28 15:21:17 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:17 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e0044f24-72f5-4c14-af2c-1fa0b4a84272" returned: 0 in 0.243s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-e0044f24-72f5-4c14-af2c-1fa0b4a84272" released by "delete_volume" :: held 0.643s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Created reservations ['df28bc3a-e366-4676-8adb-9cd14f7fc55e', 'e5a4f6f4-702d-400d-8b4b-e0b13d74adc2', '0137fd68-dd58-4f66-a66d-d6fd3609ead1', '67c36779-fbf9-4c38-876b-25e885846de2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:17 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:17 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:17 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.251s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:17 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Deleted volume successfully. Sep 28 15:21:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c7fe1ab0-c6b8-408a-8ada-3eb2e8804166 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-e0044f24-72f5-4c14-af2c-1fa0b4a84272-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (e0b5be12-7f9d-4f67-a234-b05cd49a28e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c3ccc4-436d-4469-9e3b-8d0b26170c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c3ccc4-436d-4469-9e3b-8d0b26170c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154878715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d902a2-1133-4071-a045-4e1e30978938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:18Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7920cc5f-4e96-4b96-9f03-e6a55b2c03a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7920cc5f-4e96-4b96-9f03-e6a55b2c03a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70d4524-a265-4e3b-9e58-bcf2087cf524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70d4524-a265-4e3b-9e58-bcf2087cf524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d902a2-1133-4071-a045-4e1e30978938', 'volume_name': 'volume-18d902a2-1133-4071-a045-4e1e30978938', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f71904-d101-4d51-bbdb-8245c48b50cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f71904-d101-4d51-bbdb-8245c48b50cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9046837b-cb13-498c-8627-3cc621306539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Volume 18d902a2-1133-4071-a045-4e1e30978938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d902a2-1133-4071-a045-4e1e30978938', 'volume_size': 1} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154878715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d902a2-1133-4071-a045-4e1e30978938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:18Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Creating volume 18d902a2-1133-4071-a045-4e1e30978938 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:18 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:18 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 1073741824 Sep 28 15:21:18 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:18 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 1073741824" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:18 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 Sep 28 15:21:18 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:19 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938" returned: 0 in 0.245s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9046837b-cb13-498c-8627-3cc621306539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d902a2-1133-4071-a045-4e1e30978938', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa163773-08db-4a46-af57-d53d246a7ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:19 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Volume volume-18d902a2-1133-4071-a045-4e1e30978938 (18d902a2-1133-4071-a045-4e1e30978938): created successfully Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa163773-08db-4a46-af57-d53d246a7ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (e0b5be12-7f9d-4f67-a234-b05cd49a28e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d85ac4aa-6064-4763-b7a1-32025e1d356c tempest-ProjectReaderTests-1871258678 None] Created volume successfully. Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-18d902a2-1133-4071-a045-4e1e30978938-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-18d902a2-1133-4071-a045-4e1e30978938-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-quobyte-18d902a2-1133-4071-a045-4e1e30978938" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-18d902a2-1133-4071-a045-4e1e30978938" acquired by "delete_volume" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6d80de-c83b-44f0-af13-7d670f6ed91a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 Sep 28 15:21:19 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:19 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938" returned: 0 in 0.358s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938 Sep 28 15:21:19 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-18d902a2-1133-4071-a045-4e1e30978938" returned: 0 in 0.228s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-18d902a2-1133-4071-a045-4e1e30978938" released by "delete_volume" :: held 0.627s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Created reservations ['200aa83c-8168-4778-831c-348be1a8f4a7', '050dfc06-ad73-4868-8e3b-ea9006dcb79a', '1b3fd9e8-ad61-41e4-ba73-33b7cb24feb8', '5cbc6374-ba6f-409c-9936-6a559286defb'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:20 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:20 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.243s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:20 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Deleted volume successfully. Sep 28 15:21:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d16eb4d4-53b9-4ad3-a304-7c84aeb7cef2 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-18d902a2-1133-4071-a045-4e1e30978938-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (04886e3c-f066-4a38-adbf-93eabf2dca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0f0fa-8b6f-46b7-a967-d461ef66b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0f0fa-8b6f-46b7-a967-d461ef66b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863465623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54668243-12a5-4211-a1a8-576461eeb1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:21Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858c8792-9432-4ef6-8576-1b30aa19bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858c8792-9432-4ef6-8576-1b30aa19bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91c4223-b60b-4ce4-b511-bc1caccaa544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91c4223-b60b-4ce4-b511-bc1caccaa544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54668243-12a5-4211-a1a8-576461eeb1ae', 'volume_name': 'volume-54668243-12a5-4211-a1a8-576461eeb1ae', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7daf78c-600e-4d9f-a7c0-09a0ecea4cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7daf78c-600e-4d9f-a7c0-09a0ecea4cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2c46eb-578c-4967-a8a8-39c6189f2de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Volume 54668243-12a5-4211-a1a8-576461eeb1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54668243-12a5-4211-a1a8-576461eeb1ae', 'volume_size': 1} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863465623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54668243-12a5-4211-a1a8-576461eeb1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:21Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Creating volume 54668243-12a5-4211-a1a8-576461eeb1ae {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:21 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae 1073741824 Sep 28 15:21:21 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae 1073741824" returned: 0 in 0.420s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae Sep 28 15:21:21 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae" returned: 0 in 0.248s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2c46eb-578c-4967-a8a8-39c6189f2de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54668243-12a5-4211-a1a8-576461eeb1ae', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16a0c2a-4007-4211-b60c-72d6ee4d0976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Volume volume-54668243-12a5-4211-a1a8-576461eeb1ae (54668243-12a5-4211-a1a8-576461eeb1ae): created successfully Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16a0c2a-4007-4211-b60c-72d6ee4d0976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (04886e3c-f066-4a38-adbf-93eabf2dca0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e10e6a32-57d4-4406-a368-d401e15c2db7 tempest-ProjectReaderTests-1871258678 None] Created volume successfully. Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-54668243-12a5-4211-a1a8-576461eeb1ae-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Lock "cinder-54668243-12a5-4211-a1a8-576461eeb1ae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-quobyte-54668243-12a5-4211-a1a8-576461eeb1ae" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-54668243-12a5-4211-a1a8-576461eeb1ae" acquired by "delete_volume" :: waited 0.013s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b71b639-4d67-47db-81d2-0d74af04d869]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae Sep 28 15:21:22 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae" returned: 0 in 0.406s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae Sep 28 15:21:22 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-54668243-12a5-4211-a1a8-576461eeb1ae" returned: 0 in 0.257s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-54668243-12a5-4211-a1a8-576461eeb1ae" released by "delete_volume" :: held 0.703s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Created reservations ['e9325bb9-3cbf-4e9f-8ee8-fd38b3193ac1', '431ffe29-7083-498b-b96f-dcd4f505cfe3', '247c73b9-cd0a-462e-a2be-c0bf188f4c6c', 'eb4f517f-5d71-45ed-8137-4175e685b95c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:23 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.252s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Deleted volume successfully. Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0c3e341b-b8ce-4e2a-b1a7-50799d6f75bc tempest-ProjectReaderTests-1871258678 None] Lock "cinder-54668243-12a5-4211-a1a8-576461eeb1ae-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (6ce6562a-304a-4e68-b843-50a4305fda12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99a14ce-d4eb-4e07-9bad-3c92d4802364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99a14ce-d4eb-4e07-9bad-3c92d4802364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444242281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b53658e-293b-455d-95c0-be35b2ef5f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:24Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a2d3ef-1290-47b4-865d-d80f2fdf5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a2d3ef-1290-47b4-865d-d80f2fdf5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ec6d1a-9c2f-406d-9cc1-7ecd82e6e369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ec6d1a-9c2f-406d-9cc1-7ecd82e6e369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b53658e-293b-455d-95c0-be35b2ef5f8a', 'volume_name': 'volume-9b53658e-293b-455d-95c0-be35b2ef5f8a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa55bfe-0038-4a87-a18f-c39e1afd5b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa55bfe-0038-4a87-a18f-c39e1afd5b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aa5805-bed5-4653-904c-bdcd178cd7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Volume 9b53658e-293b-455d-95c0-be35b2ef5f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b53658e-293b-455d-95c0-be35b2ef5f8a', 'volume_size': 1} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444242281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b53658e-293b-455d-95c0-be35b2ef5f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bae6321b8400d890216d388209708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:24Z,use_quota=True,user_id='3a68b3bd1d044b23a3c9bd1dba7a8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Creating volume 9b53658e-293b-455d-95c0-be35b2ef5f8a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:23 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a 1073741824 Sep 28 15:21:23 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:24 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a 1073741824" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:24 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a Sep 28 15:21:24 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:24 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a" returned: 0 in 0.286s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aa5805-bed5-4653-904c-bdcd178cd7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b53658e-293b-455d-95c0-be35b2ef5f8a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff66639-39dc-4f57-8f1e-0b270fc9f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:24 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Volume volume-9b53658e-293b-455d-95c0-be35b2ef5f8a (9b53658e-293b-455d-95c0-be35b2ef5f8a): created successfully Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff66639-39dc-4f57-8f1e-0b270fc9f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Flow 'volume_create_manager' (6ce6562a-304a-4e68-b843-50a4305fda12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:24 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e4976600-d854-4ec6-9441-8748915ebf00 tempest-ProjectReaderTests-1871258678 None] Created volume successfully. Sep 28 15:21:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-9b53658e-293b-455d-95c0-be35b2ef5f8a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-9b53658e-293b-455d-95c0-be35b2ef5f8a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "cinder-quobyte-9b53658e-293b-455d-95c0-be35b2ef5f8a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-9b53658e-293b-455d-95c0-be35b2ef5f8a" acquired by "delete_volume" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bef6eb-e739-468f-8fdf-1a1f051db83e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:26 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a Sep 28 15:21:26 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:26 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a" returned: 0 in 0.385s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:26 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a Sep 28 15:21:26 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:26 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-9b53658e-293b-455d-95c0-be35b2ef5f8a" returned: 0 in 0.259s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-quobyte-9b53658e-293b-455d-95c0-be35b2ef5f8a" released by "delete_volume" :: held 0.695s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Created reservations ['08f4044c-5b1c-4c3f-bc61-366de5f12af6', '4b07438f-a29e-4d57-9376-ce3c5f134bc4', 'cbb8ebd5-ed93-42f1-8c7d-d143243c5e1b', 'd0e89266-58d4-43f6-9b36-a2a7794ba6c4'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:26 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:26 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:27 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.241s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:27 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Deleted volume successfully. Sep 28 15:21:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c02478d3-c47f-42ce-a9b9-3719142f6c12 tempest-ProjectReaderTests-1871258678 None] Lock "cinder-9b53658e-293b-455d-95c0-be35b2ef5f8a-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:35 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=90,cinder:INSERT=31,cinder:UPDATE=121,cinder:DELETE=11 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:35 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=86,cinder:UPDATE=136,cinder:DELETE=12,cinder:INSERT=29 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:37 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:37 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:37 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.470s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:21:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (8b71fbea-f093-4e82-90f8-e5e8f2309efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029e126f-768e-43fb-87d6-c2e4d8f08c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029e126f-768e-43fb-87d6-c2e4d8f08c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095997709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9943fc9-ce76-4a14-ba58-a2577010511c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:41Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e9c6a-442e-43c7-8dc8-76e27553cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e9c6a-442e-43c7-8dc8-76e27553cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33efd21-0ac0-4173-b143-1bbf5dbab2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33efd21-0ac0-4173-b143-1bbf5dbab2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9943fc9-ce76-4a14-ba58-a2577010511c', 'volume_name': 'volume-f9943fc9-ce76-4a14-ba58-a2577010511c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424c6a03-fcab-41e9-ba33-3bdbe72fd63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424c6a03-fcab-41e9-ba33-3bdbe72fd63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec51c833-90ee-42d1-b8a9-d9ccdac969ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Volume f9943fc9-ce76-4a14-ba58-a2577010511c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9943fc9-ce76-4a14-ba58-a2577010511c', 'volume_size': 1} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095997709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9943fc9-ce76-4a14-ba58-a2577010511c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:41Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Creating volume f9943fc9-ce76-4a14-ba58-a2577010511c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:41 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:41 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c 1073741824 Sep 28 15:21:41 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (1a32fae2-9950-4598-b60a-348edbcb35f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6f8f2b-5256-4ad2-ae71-c939b30612c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (21df1af1-ecc9-47fb-a205-403bc6f2632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3aa0d-509c-489d-aaa6-4f22014e52e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3aa0d-509c-489d-aaa6-4f22014e52e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714887671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:41Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4b2f42-d715-4e4a-a447-5d12797c8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4b2f42-d715-4e4a-a447-5d12797c8750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65e7913-9ef2-4c4f-9935-77d4b4275ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65e7913-9ef2-4c4f-9935-77d4b4275ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a', 'volume_name': 'volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792aaa8c-6316-4aa8-af9d-9af292d49dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792aaa8c-6316-4aa8-af9d-9af292d49dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25548c9b-6bf5-4fe4-92bc-2943d23b0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Volume 1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a', 'volume_size': 1} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6f8f2b-5256-4ad2-ae71-c939b30612c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941006016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6784c7-395b-41b9-90a2-d255102e6225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:41Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd20b072-ce8a-43a0-96a2-ef92906adf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd20b072-ce8a-43a0-96a2-ef92906adf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b46b1f7-d775-4c55-8f34-c6be024db61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b46b1f7-d775-4c55-8f34-c6be024db61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6784c7-395b-41b9-90a2-d255102e6225', 'volume_name': 'volume-1e6784c7-395b-41b9-90a2-d255102e6225', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d1769d-f05a-47eb-b5de-9b63782448ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d1769d-f05a-47eb-b5de-9b63782448ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc2423c-f349-4e1c-af97-88229c6f6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume 1e6784c7-395b-41b9-90a2-d255102e6225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6784c7-395b-41b9-90a2-d255102e6225', 'volume_size': 1} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (f8788846-a416-43d7-bec2-660729cecfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428b5c9c-fb05-435f-ac56-a0d456e48d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428b5c9c-fb05-435f-ac56-a0d456e48d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461975495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946c406f-2993-49a7-96c7-c19651d9c40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:42Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7e78e1-6070-4262-8f4e-1c37a8bc9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7e78e1-6070-4262-8f4e-1c37a8bc9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b403d3c-1146-4022-940e-826bbef8d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b403d3c-1146-4022-940e-826bbef8d93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946c406f-2993-49a7-96c7-c19651d9c40b', 'volume_name': 'volume-946c406f-2993-49a7-96c7-c19651d9c40b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39437e9e-f48c-4f96-adba-b6d594a66d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39437e9e-f48c-4f96-adba-b6d594a66d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34556292-7082-4333-8db5-966c4806845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Volume 946c406f-2993-49a7-96c7-c19651d9c40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946c406f-2993-49a7-96c7-c19651d9c40b', 'volume_size': 1} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:42 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c 1073741824" returned: 0 in 0.703s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:42 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c Sep 28 15:21:42 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (31048980-38c6-48a4-aa97-07b3c0cd7757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766e1845-4f68-47af-a060-965caaf0b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766e1845-4f68-47af-a060-965caaf0b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1647445598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6cc5ec-308a-4dfb-a678-24d8c81ead2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:42Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f02a21-d871-4a0d-a4d5-e9f346178dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f02a21-d871-4a0d-a4d5-e9f346178dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6333691-d02a-44b9-8129-56b87b51f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6333691-d02a-44b9-8129-56b87b51f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6cc5ec-308a-4dfb-a678-24d8c81ead2c', 'volume_name': 'volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc712d51-99c5-4b4a-8a12-0c041a6c64ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc712d51-99c5-4b4a-8a12-0c041a6c64ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235951fa-ec95-4e02-8fa1-770d79b31ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Volume 3a6cc5ec-308a-4dfb-a678-24d8c81ead2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c', 'volume_size': 1} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:42 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c" returned: 0 in 0.482s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714887671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:41Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Creating volume 1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:42 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:42 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a 1073741824 Sep 28 15:21:42 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec51c833-90ee-42d1-b8a9-d9ccdac969ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9943fc9-ce76-4a14-ba58-a2577010511c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa79587-2886-47dc-a43b-3228b22749ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Volume volume-f9943fc9-ce76-4a14-ba58-a2577010511c (f9943fc9-ce76-4a14-ba58-a2577010511c): created successfully Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa79587-2886-47dc-a43b-3228b22749ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (8b71fbea-f093-4e82-90f8-e5e8f2309efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6ce850a3-609b-4468-bf4b-4eddd19ffcee tempest-CreateVolumesFromImageTest-1314756423 None] Created volume successfully. Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (81f9f5a2-9df0-485c-a12c-d7998febaab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1679bf4b-acf8-451f-97d4-d046ed5ea358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1679bf4b-acf8-451f-97d4-d046ed5ea358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-719752054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb01cac-efe9-4962-a5ed-7d51f62444b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:43Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27210908-b7b5-4669-a796-ef11dda3e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27210908-b7b5-4669-a796-ef11dda3e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27603ba-6e22-4e7e-ab90-70a52a8f13d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27603ba-6e22-4e7e-ab90-70a52a8f13d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb01cac-efe9-4962-a5ed-7d51f62444b5', 'volume_name': 'volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7c5826-974d-4264-8902-b6bec50a807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7c5826-974d-4264-8902-b6bec50a807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb180b73-fa4d-4def-9302-b3983cfddef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Volume 1cb01cac-efe9-4962-a5ed-7d51f62444b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5', 'volume_size': 1} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:43 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a 1073741824" returned: 0 in 0.757s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:43 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a Sep 28 15:21:43 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:43 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a" returned: 0 in 0.361s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941006016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6784c7-395b-41b9-90a2-d255102e6225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:41Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Creating volume 1e6784c7-395b-41b9-90a2-d255102e6225 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:43 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25548c9b-6bf5-4fe4-92bc-2943d23b0184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:43 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 1073741824 Sep 28 15:21:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2b852c-7387-4e4b-b8a4-89e417ed5d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:43 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Volume volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a (1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a): created successfully Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2b852c-7387-4e4b-b8a4-89e417ed5d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (21df1af1-ecc9-47fb-a205-403bc6f2632d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:44 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-768fd183-f383-4b97-8a04-65a60581b475 tempest-CreateVolumesFromImageTest-1314756423 None] Created volume successfully. Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Flow 'volume_create_manager' (cf73b03e-4bb0-4770-907e-6f6537ebca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0d153b-6819-4136-b3dc-640985b27274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0d153b-6819-4136-b3dc-640985b27274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0697403-d299-41c7-a940-abaf1b0d1048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d09d6cd9a6b4dc79f908dc7b2208e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:44Z,use_quota=True,user_id='b76f830a2e584fd6ac0d372b79680a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27725ecb-7d43-4fbd-aded-e97164709767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27725ecb-7d43-4fbd-aded-e97164709767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bb2e6b-acb1-4b48-b75f-73612058bf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:21:44 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 1073741824" returned: 0 in 0.629s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:44 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 Sep 28 15:21:44 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bb2e6b-acb1-4b48-b75f-73612058bf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0697403-d299-41c7-a940-abaf1b0d1048', 'volume_name': 'volume-a0697403-d299-41c7-a940-abaf1b0d1048', 'volume_size': 1, 'image_id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c265fa32-579a-436c-951d-9beb6acd7b3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e89bf576c0ee27ed4a95f829447a872', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d09d6cd9a6b4dc79f908dc7b2208e6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfb1ff96ef3ce67efa782b7174907c6251f7840160008fcb24e88a5929d5e71a9dcdeb8a3c724e675bc08f501476fb2194651d8a71442d1db4e27d95ca9d21a7', 'id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c265fa32-579a-436c-951d-9beb6acd7b3e/file', 'properties': {}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c8592e-bc24-428c-a4e0-a9a90f65d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c8592e-bc24-428c-a4e0-a9a90f65d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e150601-fec3-4bb5-93c1-b8c6665816cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:44 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Volume a0697403-d299-41c7-a940-abaf1b0d1048: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0697403-d299-41c7-a940-abaf1b0d1048', 'volume_size': 1, 'image_id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c265fa32-579a-436c-951d-9beb6acd7b3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e89bf576c0ee27ed4a95f829447a872', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d09d6cd9a6b4dc79f908dc7b2208e6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfb1ff96ef3ce67efa782b7174907c6251f7840160008fcb24e88a5929d5e71a9dcdeb8a3c724e675bc08f501476fb2194651d8a71442d1db4e27d95ca9d21a7', 'id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c265fa32-579a-436c-951d-9beb6acd7b3e/file', 'properties': {}}, 'image_service': } Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Trying to clone a0697403-d299-41c7-a940-abaf1b0d1048 from image c265fa32-579a-436c-951d-9beb6acd7b3e at location (None, [{'url': 'file:///opt/stack/data/glance/images/c265fa32-579a-436c-951d-9beb6acd7b3e', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:21:44 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225" returned: 0 in 0.302s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.932s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461975495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946c406f-2993-49a7-96c7-c19651d9c40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:42Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Creating volume 946c406f-2993-49a7-96c7-c19651d9c40b {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:44 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc2423c-f349-4e1c-af97-88229c6f6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6784c7-395b-41b9-90a2-d255102e6225', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d29f8a0-c3dd-41c4-9499-8e5f72227670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:44 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b 1073741824 Sep 28 15:21:44 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:21:45 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:21:45 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume volume-1e6784c7-395b-41b9-90a2-d255102e6225 (1e6784c7-395b-41b9-90a2-d255102e6225): created successfully Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d29f8a0-c3dd-41c4-9499-8e5f72227670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (1a32fae2-9950-4598-b60a-348edbcb35f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:45 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c7e5263b-0537-4659-9266-54e4de505be9 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created volume successfully. Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7ec7be-2a58-4026-830d-f436826cdde4]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:45 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD Sep 28 15:21:45 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:45 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:45 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b 1073741824" returned: 0 in 0.604s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:45 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD Sep 28 15:21:45 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:45 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b Sep 28 15:21:45 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:45 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Flow 'volume_create_manager' (6f14a27b-4ff6-4139-ac07-bf533cf4bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:45 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7698bb7f-5296-40b2-96f6-7e5b009bd7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD" returned: 1 in 0.496s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:45 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Temporary image c265fa32-579a-436c-951d-9beb6acd7b3e is fetched for user b76f830a2e584fd6ac0d372b79680a80. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b" returned: 0 in 0.374s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.487s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1647445598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6cc5ec-308a-4dfb-a678-24d8c81ead2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:42Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Creating volume 3a6cc5ec-308a-4dfb-a678-24d8c81ead2c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:46 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c 1073741824 Sep 28 15:21:46 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7698bb7f-5296-40b2-96f6-7e5b009bd7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bdd0b2-d9b9-47a5-9529-869c4c03eddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fb400a1437449d9b4666c79f683e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:46Z,use_quota=True,user_id='f9be953e29f647a29c65c5c5b7c7ed67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(056c16dc-c357-4415-817c-b3fa155d999d),volume_type_id=056c16dc-c357-4415-817c-b3fa155d999d)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7e842f-ceac-41e1-a7c3-b3a7e9f2f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7e842f-ceac-41e1-a7c3-b3a7e9f2f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9477d1a-8f42-40dc-bf96-a7be9aa294a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.image.glance [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Creating Keystone auth plugin from conf {{(pid=87124) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34556292-7082-4333-8db5-966c4806845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946c406f-2993-49a7-96c7-c19651d9c40b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a83435b-be8e-4caa-8a59-0f55876229d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Volume volume-946c406f-2993-49a7-96c7-c19651d9c40b (946c406f-2993-49a7-96c7-c19651d9c40b): created successfully Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a83435b-be8e-4caa-8a59-0f55876229d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (f8788846-a416-43d7-bec2-660729cecfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (50c9ba6d-0b5a-4535-9ae2-883099cd3697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62893808-7ee2-469d-b152-e504329c5d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[396cc2ba-64e4-4fad-9829-62da2f6dbbb2]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-297bd058-e138-4744-8375-3cd59f0f5f91 tempest-CreateVolumesFromImageTest-1314756423 None] Created volume successfully. Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62893808-7ee2-469d-b152-e504329c5d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328771237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af813f4f-d562-414b-87c1-e57a01ab5c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:46Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274b937a-9a56-4fcf-a632-2b87c361be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274b937a-9a56-4fcf-a632-2b87c361be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa040e-1217-455c-bd76-8e10a36d7ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa040e-1217-455c-bd76-8e10a36d7ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af813f4f-d562-414b-87c1-e57a01ab5c82', 'volume_name': 'volume-af813f4f-d562-414b-87c1-e57a01ab5c82', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78b6628-34ff-4e92-b6ad-0a20fdf77ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD Sep 28 15:21:46 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78b6628-34ff-4e92-b6ad-0a20fdf77ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ec77e6-0e9e-49af-a753-e7b4ee71932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume af813f4f-d562-414b-87c1-e57a01ab5c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af813f4f-d562-414b-87c1-e57a01ab5c82', 'volume_size': 1} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9477d1a-8f42-40dc-bf96-a7be9aa294a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48bdd0b2-d9b9-47a5-9529-869c4c03eddd', 'volume_name': 'volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd', 'volume_size': 1, 'image_id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1363cf51-dc8b-4daa-9fac-03256b348aff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57e695eb31ade28d237389e35f9b6164', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46fb400a1437449d9b4666c79f683e4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '962dee2eebbcdbe0df421e24ac9cf621771750c22eab61066607818dec4b44cf8801cd0986ac08ec66b8acc38624d7ad858ed59c95cbf294d9d2545c7d5d28b2', 'id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1363cf51-dc8b-4daa-9fac-03256b348aff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c85485-d38c-483e-b9f9-9ad9f02a5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c85485-d38c-483e-b9f9-9ad9f02a5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccf2e1c-4d81-4f09-a5e5-ca32b4b3bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Volume 48bdd0b2-d9b9-47a5-9529-869c4c03eddd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd', 'volume_size': 1, 'image_id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1363cf51-dc8b-4daa-9fac-03256b348aff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57e695eb31ade28d237389e35f9b6164', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46fb400a1437449d9b4666c79f683e4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '962dee2eebbcdbe0df421e24ac9cf621771750c22eab61066607818dec4b44cf8801cd0986ac08ec66b8acc38624d7ad858ed59c95cbf294d9d2545c7d5d28b2', 'id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1363cf51-dc8b-4daa-9fac-03256b348aff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Trying to clone 48bdd0b2-d9b9-47a5-9529-869c4c03eddd from image 1363cf51-dc8b-4daa-9fac-03256b348aff at location (None, [{'url': 'file:///opt/stack/data/glance/images/1363cf51-dc8b-4daa-9fac-03256b348aff', 'metadata': {}}]). {{(pid=87124) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (486d7b7b-ce03-415e-a7da-b8986128df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:46 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb680184-14cd-4399-8ea0-ca667c9a99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c 1073741824" returned: 0 in 0.711s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb680184-14cd-4399-8ea0-ca667c9a99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891136702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6b4532-44a8-4977-85fe-d40f04f6ad46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:47Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787555ab-b22d-4fff-8e7c-44c0f4fc0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787555ab-b22d-4fff-8e7c-44c0f4fc0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1127b1-36b1-4fb0-91dc-d59e451bf3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1127b1-36b1-4fb0-91dc-d59e451bf3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6b4532-44a8-4977-85fe-d40f04f6ad46', 'volume_name': 'volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e78844-9936-404c-8551-de242ad2ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e78844-9936-404c-8551-de242ad2ab05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503d28e7-91a6-4155-a88c-c99a56d6bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume 6e6b4532-44a8-4977-85fe-d40f04f6ad46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46', 'volume_size': 1} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:21:46 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:21:46 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c Sep 28 15:21:46 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:46 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD Sep 28 15:21:46 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7cbd17-1861-4d6d-bb9f-343042609762]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:47 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD Sep 28 15:21:47 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:47 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c" returned: 0 in 0.350s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:47 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.867s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-719752054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb01cac-efe9-4962-a5ed-7d51f62444b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091dcd1bb5641f4b9d8669d621bc739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:43Z,use_quota=True,user_id='36d14a9fbb05470eb61613e5ff854109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Creating volume 1cb01cac-efe9-4962-a5ed-7d51f62444b5 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:47 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD" returned: 1 in 0.534s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 1073741824 Sep 28 15:21:47 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235951fa-ec95-4e02-8fa1-770d79b31ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5418c5b-7b21-48b4-b376-4ab7b53465c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Volume volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c (3a6cc5ec-308a-4dfb-a678-24d8c81ead2c): created successfully Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5418c5b-7b21-48b4-b376-4ab7b53465c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (31048980-38c6-48a4-aa97-07b3c0cd7757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e4149f49-8db4-42b1-93da-1374fc785956 tempest-CreateVolumesFromImageTest-1314756423 None] Created volume successfully. Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (bb5b4a9f-5d7c-4431-b3f2-3ca7a6e26dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:47 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b26870-f510-40bd-8a89-a2d92e1ff741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b26870-f510-40bd-8a89-a2d92e1ff741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242137878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28798d01-d16b-4e36-baa7-35a4a52a819b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:47Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70a74f2-a9ca-4e5d-b54a-2f8c6eb229b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70a74f2-a9ca-4e5d-b54a-2f8c6eb229b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653718d7-ef8a-428d-9042-c341c5b2f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653718d7-ef8a-428d-9042-c341c5b2f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28798d01-d16b-4e36-baa7-35a4a52a819b', 'volume_name': 'volume-28798d01-d16b-4e36-baa7-35a4a52a819b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f5765-c2ce-411c-b77e-982bba73ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f5765-c2ce-411c-b77e-982bba73ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f13116a-e8fc-48e5-8720-831f979e1652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume 28798d01-d16b-4e36-baa7-35a4a52a819b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28798d01-d16b-4e36-baa7-35a4a52a819b', 'volume_size': 1} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD Sep 28 15:21:47 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (08957826-cc08-4d99-a100-7c4d0ffc8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a29a2b5-ef89-4eb1-b638-059c47711de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a29a2b5-ef89-4eb1-b638-059c47711de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412119921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45026309-89a3-4a83-a88e-d224071f3e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c7c38e-5c1d-487b-a2c3-597e7d7a8be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c7c38e-5c1d-487b-a2c3-597e7d7a8be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c33b24-b50f-4c5b-84fe-9f523b2f274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c33b24-b50f-4c5b-84fe-9f523b2f274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45026309-89a3-4a83-a88e-d224071f3e1c', 'volume_name': 'volume-45026309-89a3-4a83-a88e-d224071f3e1c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb49d7b3-e129-4641-956b-87dbfe01123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb49d7b3-e129-4641-956b-87dbfe01123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46f75e7-48cc-4846-acd2-194be69ddc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume 45026309-89a3-4a83-a88e-d224071f3e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45026309-89a3-4a83-a88e-d224071f3e1c', 'volume_size': 1} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 1073741824" returned: 0 in 0.757s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD" returned: 1 in 0.506s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:47 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Temporary image 1363cf51-dc8b-4daa-9fac-03256b348aff is fetched for user f9be953e29f647a29c65c5c5b7c7ed67. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 Sep 28 15:21:48 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3987705b-42ed-4596-9380-c039ae76ddf9]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD Sep 28 15:21:48 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (13103f06-5c75-4448-923c-d0ecf6deace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bba7845-4375-4490-a85c-0934c0baaed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5" returned: 0 in 0.346s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328771237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af813f4f-d562-414b-87c1-e57a01ab5c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:46Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Creating volume af813f4f-d562-414b-87c1-e57a01ab5c82 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:48 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bba7845-4375-4490-a85c-0934c0baaed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302556714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a175f7a-f655-407e-8331-267f30f09417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 1073741824 Sep 28 15:21:48 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6f091c-1942-4e5d-a09f-a6d5310724f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6f091c-1942-4e5d-a09f-a6d5310724f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac929f44-2eb1-4929-86a0-8faa3d63f80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac929f44-2eb1-4929-86a0-8faa3d63f80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a175f7a-f655-407e-8331-267f30f09417', 'volume_name': 'volume-4a175f7a-f655-407e-8331-267f30f09417', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c9a7c5-51b0-4dcd-b374-2006b4b555b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c9a7c5-51b0-4dcd-b374-2006b4b555b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e089d3-2757-4a46-b682-92555d7867ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume 4a175f7a-f655-407e-8331-267f30f09417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a175f7a-f655-407e-8331-267f30f09417', 'volume_size': 1} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb180b73-fa4d-4def-9302-b3983cfddef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9255ed35-9e26-4140-b3d1-92605f4e7710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:48 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Volume volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 (1cb01cac-efe9-4962-a5ed-7d51f62444b5): created successfully Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9255ed35-9e26-4140-b3d1-92605f4e7710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Flow 'volume_create_manager' (81f9f5a2-9df0-485c-a12c-d7998febaab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-85f5ff7b-a02e-4361-8272-e92e4180e90f tempest-CreateVolumesFromImageTest-1314756423 None] Created volume successfully. Sep 28 15:21:48 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD Sep 28 15:21:48 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 1073741824" returned: 0 in 0.467s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:48 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 Sep 28 15:21:48 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82" returned: 0 in 0.252s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.342s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891136702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6b4532-44a8-4977-85fe-d40f04f6ad46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:47Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Creating volume 6e6b4532-44a8-4977-85fe-d40f04f6ad46 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ec77e6-0e9e-49af-a753-e7b4ee71932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af813f4f-d562-414b-87c1-e57a01ab5c82', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 1073741824 Sep 28 15:21:49 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d13f12-0dab-4908-b4b1-dbbb05122e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-1cb01cac-efe9-4962-a5ed-7d51f62444b5-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-1cb01cac-efe9-4962-a5ed-7d51f62444b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:49 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume volume-af813f4f-d562-414b-87c1-e57a01ab5c82 (af813f4f-d562-414b-87c1-e57a01ab5c82): created successfully Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d13f12-0dab-4908-b4b1-dbbb05122e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (50c9ba6d-0b5a-4535-9ae2-883099cd3697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e1957739-906d-441f-bf80-1cb2e5ae8b37 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created volume successfully. Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-quobyte-1cb01cac-efe9-4962-a5ed-7d51f62444b5" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-1cb01cac-efe9-4962-a5ed-7d51f62444b5" acquired by "delete_volume" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40f14ea-b0fa-45c3-95f0-3d139233b861]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 Sep 28 15:21:49 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 1073741824" returned: 0 in 0.489s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 Sep 28 15:21:49 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5" returned: 0 in 0.409s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5 Sep 28 15:21:49 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.706s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0697403-d299-41c7-a940-abaf1b0d1048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d09d6cd9a6b4dc79f908dc7b2208e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:44Z,use_quota=True,user_id='b76f830a2e584fd6ac0d372b79680a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Creating volume a0697403-d299-41c7-a940-abaf1b0d1048 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503d28e7-91a6-4155-a88c-c99a56d6bea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 1073741824 Sep 28 15:21:49 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6c5a73-ebb0-408a-8352-1eb0b8a1d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1cb01cac-efe9-4962-a5ed-7d51f62444b5" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 (6e6b4532-44a8-4977-85fe-d40f04f6ad46): created successfully Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6c5a73-ebb0-408a-8352-1eb0b8a1d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (486d7b7b-ce03-415e-a7da-b8986128df1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-1cb01cac-efe9-4962-a5ed-7d51f62444b5" released by "delete_volume" :: held 0.739s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-655eaaec-cf38-4469-b5cc-08acfe6f8179 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created volume successfully. Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Created reservations ['2f899f56-604c-4274-953e-8992a55f8a1f', '900567c9-486f-4597-a21e-8dfd047a099d', 'bae9f0a5-dabc-4efc-8309-01a535fe3c6a', '494dd6fb-56f1-4196-9c2d-f94c93dc1501'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:50 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:50 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:50 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Deleted volume successfully. Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-quobyte-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:50 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c65ca8e0-3379-440f-8a91-bebdbae41e08 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-1cb01cac-efe9-4962-a5ed-7d51f62444b5-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 1073741824" returned: 0 in 0.676s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba723031-5363-419a-b842-ae82d6f90205]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:50 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 Sep 28 15:21:50 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:50 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c Sep 28 15:21:50 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:50 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048" returned: 0 in 0.314s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.441s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242137878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28798d01-d16b-4e36-baa7-35a4a52a819b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:47Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Creating volume 28798d01-d16b-4e36-baa7-35a4a52a819b {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:51 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c" returned: 0 in 0.391s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b 1073741824 Sep 28 15:21:51 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c Sep 28 15:21:51 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Attempting download of c265fa32-579a-436c-951d-9beb6acd7b3e ((None, [{'url': 'file:///opt/stack/data/glance/images/c265fa32-579a-436c-951d-9beb6acd7b3e', 'metadata': {}}])) to volume a0697403-d299-41c7-a940-abaf1b0d1048. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c936b-e01b-415f-98f4-cb59c69ce931]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983 Sep 28 15:21:51 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c" released by "delete_volume" :: held 0.705s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Created reservations ['76a7f2a6-e19e-4f3b-8865-2a257d9f35bb', '84e1606d-1e64-433f-ab45-87ad1c573684', '89217a91-6c85-4b79-8980-8d247c8bfbb3', '1970c2e7-fa5e-4374-bb4d-87ee40ab9bb9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:51 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b 1073741824" returned: 0 in 0.538s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983" returned: 0 in 0.429s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b Sep 28 15:21:51 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-946c406f-2993-49a7-96c7-c19651d9c40b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-946c406f-2993-49a7-96c7-c19651d9c40b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:51 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-quobyte-946c406f-2993-49a7-96c7-c19651d9c40b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.310s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:51 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983 Sep 28 15:21:51 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Deleted volume successfully. Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-946c406f-2993-49a7-96c7-c19651d9c40b" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-c4754146-f370-473c-9161-724196abdf26 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-3a6cc5ec-308a-4dfb-a678-24d8c81ead2c-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb68e4c-814e-47a5-bc6a-e1c8edbced21]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b" returned: 0 in 0.362s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.052s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412119921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45026309-89a3-4a83-a88e-d224071f3e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Creating volume 45026309-89a3-4a83-a88e-d224071f3e1c {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:52 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b Sep 28 15:21:52 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:52 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c 1073741824 Sep 28 15:21:52 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f13116a-e8fc-48e5-8720-831f979e1652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28798d01-d16b-4e36-baa7-35a4a52a819b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92025c29-fae9-461a-b308-916b23ac14a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume volume-28798d01-d16b-4e36-baa7-35a4a52a819b (28798d01-d16b-4e36-baa7-35a4a52a819b): created successfully Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92025c29-fae9-461a-b308-916b23ac14a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (bb5b4a9f-5d7c-4431-b3f2-3ca7a6e26dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-66329b84-d188-4ff1-a348-3a44c610f372 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created volume successfully. Sep 28 15:21:52 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983" returned: 1 in 0.622s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c265fa32-579a-436c-951d-9beb6acd7b3e_e2rvh983' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69de38-08f8-4938-9302-5de89167f4d1]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b" returned: 0 in 0.423s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD Sep 28 15:21:52 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b Sep 28 15:21:52 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-946c406f-2993-49a7-96c7-c19651d9c40b" returned: 0 in 0.307s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c 1073741824" returned: 0 in 0.606s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-946c406f-2993-49a7-96c7-c19651d9c40b" released by "delete_volume" :: held 0.808s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD Sep 28 15:21:52 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c Sep 28 15:21:52 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Created reservations ['a454d3f8-16c0-45ae-81ed-b24403ca8806', 'ff90c291-cff9-4953-83da-fcf33300bdee', 'c8a8133e-38f9-4df0-b46a-1378eeb9b4b1', 'e50e2b7b-3b99-4bbf-a94b-a87ebaf0ee3a'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:52 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] c265fa32-579a-436c-951d-9beb6acd7b3e was raw, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.619s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302556714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a175f7a-f655-407e-8331-267f30f09417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cdf9c7bcbb40d9b6cd898e29a9e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='1f3d1f3513554ebe8b947071af8b0712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Creating volume 4a175f7a-f655-407e-8331-267f30f09417 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:53 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:53 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 1073741824 Sep 28 15:21:53 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46f75e7-48cc-4846-acd2-194be69ddc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45026309-89a3-4a83-a88e-d224071f3e1c', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a033ae75-b72b-4701-9162-046bd414b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume volume-45026309-89a3-4a83-a88e-d224071f3e1c (45026309-89a3-4a83-a88e-d224071f3e1c): created successfully Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a033ae75-b72b-4701-9162-046bd414b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (08957826-cc08-4d99-a100-7c4d0ffc8718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-quobyte-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1eb0d7df-84f5-4374-a6c4-5076b069f36c tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created volume successfully. Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a" acquired by "delete_volume" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab58104-6441-4abf-be93-3009a0b26b83]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Deleted volume successfully. Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79bd6813-daaa-4935-9696-6eb3b0648ce4 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-946c406f-2993-49a7-96c7-c19651d9c40b-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:53 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a Sep 28 15:21:53 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 1073741824" returned: 0 in 0.525s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048" returned: 0 in 0.584s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c265fa32-579a-436c-951d-9beb6acd7b3e_jn073vdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:21:53 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 1G Sep 28 15:21:53 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 Sep 28 15:21:53 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a" returned: 0 in 0.483s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a Sep 28 15:21:53 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417" returned: 0 in 0.271s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.048s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bdd0b2-d9b9-47a5-9529-869c4c03eddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fb400a1437449d9b4666c79f683e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:46Z,use_quota=True,user_id='f9be953e29f647a29c65c5c5b7c7ed67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(056c16dc-c357-4415-817c-b3fa155d999d),volume_type_id=056c16dc-c357-4415-817c-b3fa155d999d)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Creating volume 48bdd0b2-d9b9-47a5-9529-869c4c03eddd {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:53 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e089d3-2757-4a46-b682-92555d7867ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a175f7a-f655-407e-8331-267f30f09417', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:53 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23278a0-6932-47d2-b76a-187f46bcdb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:53 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd 1073741824 Sep 28 15:21:53 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a" returned: 0 in 0.297s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a" released by "delete_volume" :: held 0.839s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:54 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 1G" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Volume volume-4a175f7a-f655-407e-8331-267f30f09417 (4a175f7a-f655-407e-8331-267f30f09417): created successfully Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23278a0-6932-47d2-b76a-187f46bcdb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Flow 'volume_create_manager' (13103f06-5c75-4448-923c-d0ecf6deace9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Downloaded image c265fa32-579a-436c-951d-9beb6acd7b3e ((None, [{'url': 'file:///opt/stack/data/glance/images/c265fa32-579a-436c-951d-9beb6acd7b3e', 'metadata': {}}])) to volume a0697403-d299-41c7-a940-abaf1b0d1048 successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Temporary image c265fa32-579a-436c-951d-9beb6acd7b3e for user b76f830a2e584fd6ac0d372b79680a80 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Marking volume a0697403-d299-41c7-a940-abaf1b0d1048 as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Copying metadata from image c265fa32-579a-436c-951d-9beb6acd7b3e to a0697403-d299-41c7-a940-abaf1b0d1048. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Creating volume glance metadata for volume a0697403-d299-41c7-a940-abaf1b0d1048 backed by image c265fa32-579a-436c-951d-9beb6acd7b3e with: {'image_id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7e89bf576c0ee27ed4a95f829447a872', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:21:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-96fd65f5-651d-4214-8551-feb8731fa40f tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created volume successfully. Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Created reservations ['574bdef0-21c8-47c7-99c1-49305d423cdc', '43b5231a-b848-4b6c-9e3a-7f1f3c217653', '6f32d697-f384-44a9-820b-36bf9f7b47a6', 'eeadec1b-5b18-4a31-b030-bc85da796f79'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e150601-fec3-4bb5-93c1-b8c6665816cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0697403-d299-41c7-a940-abaf1b0d1048', 'volume_size': 1, 'image_id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c265fa32-579a-436c-951d-9beb6acd7b3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e89bf576c0ee27ed4a95f829447a872', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d09d6cd9a6b4dc79f908dc7b2208e6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfb1ff96ef3ce67efa782b7174907c6251f7840160008fcb24e88a5929d5e71a9dcdeb8a3c724e675bc08f501476fb2194651d8a71442d1db4e27d95ca9d21a7', 'id': 'c265fa32-579a-436c-951d-9beb6acd7b3e', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c265fa32-579a-436c-951d-9beb6acd7b3e/file', 'properties': {}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7780e7d-5289-46d6-a858-42320821f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Volume volume-a0697403-d299-41c7-a940-abaf1b0d1048 (a0697403-d299-41c7-a940-abaf1b0d1048): created successfully Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7780e7d-5289-46d6-a858-42320821f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Flow 'volume_create_manager' (cf73b03e-4bb0-4770-907e-6f6537ebca87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b476ac17-7a83-482a-bcbe-edb4c673efb2 tempest-VolumeImageDependencyTests-1108637690 None] Created volume successfully. Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:54 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd 1073741824" returned: 0 in 0.532s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd Sep 28 15:21:54 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.288s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:54 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Deleted volume successfully. Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0752f6c5-732e-4893-8ff7-b85533a54705 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-1a8bdf72-bf7e-48d1-9b2d-b5aee67be23a-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:54 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" returned: 0 in 0.246s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Attempting download of 1363cf51-dc8b-4daa-9fac-03256b348aff ((None, [{'url': 'file:///opt/stack/data/glance/images/1363cf51-dc8b-4daa-9fac-03256b348aff', 'metadata': {}}])) to volume 48bdd0b2-d9b9-47a5-9529-869c4c03eddd. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[05580023-7981-4884-8107-401f6cc354af]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9 Sep 28 15:21:54 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-4a175f7a-f655-407e-8331-267f30f09417-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-4a175f7a-f655-407e-8331-267f30f09417-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9" returned: 0 in 0.350s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-quobyte-4a175f7a-f655-407e-8331-267f30f09417" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-4a175f7a-f655-407e-8331-267f30f09417" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c9e465-e8fc-4743-a8a9-7345f0cacee2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-f9943fc9-ce76-4a14-ba58-a2577010511c-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9 Sep 28 15:21:55 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Acquiring lock "cinder-a0697403-d299-41c7-a940-abaf1b0d1048-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-f9943fc9-ce76-4a14-ba58-a2577010511c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Lock "cinder-a0697403-d299-41c7-a940-abaf1b0d1048-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "cinder-quobyte-f9943fc9-ce76-4a14-ba58-a2577010511c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Acquiring lock "cinder-quobyte-a0697403-d299-41c7-a940-abaf1b0d1048" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-f9943fc9-ce76-4a14-ba58-a2577010511c" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Lock "cinder-quobyte-a0697403-d299-41c7-a940-abaf1b0d1048" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9d732-5d76-45a0-99f1-03b33cc2509e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc53602a-80f1-4ea5-8755-74b1ef886e2d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c Sep 28 15:21:55 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9" returned: 1 in 0.485s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1363cf51-dc8b-4daa-9fac-03256b348aff_v4tr3dg9' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b820413-70d0-4a9d-8a50-668d996a6351]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 Sep 28 15:21:55 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD Sep 28 15:21:55 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417" returned: 0 in 0.543s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417 Sep 28 15:21:55 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c" returned: 0 in 0.425s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c Sep 28 15:21:56 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048 Sep 28 15:21:56 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-4a175f7a-f655-407e-8331-267f30f09417" returned: 0 in 0.301s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-4a175f7a-f655-407e-8331-267f30f09417" released by "delete_volume" :: held 0.931s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:56 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD Sep 28 15:21:56 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9943fc9-ce76-4a14-ba58-a2577010511c" returned: 0 in 0.297s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created reservations ['eb8579c1-0560-4707-b1f9-2fce1cc6886d', '62eddfdd-0412-4b4d-8172-e8094fd95fc4', 'bc8b8f4d-d58e-4d38-85ee-ce0ee2df303c', '7f14a274-af72-4742-8772-82a6b0bb02ec'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-quobyte-f9943fc9-ce76-4a14-ba58-a2577010511c" released by "delete_volume" :: held 0.819s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:56 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a0697403-d299-41c7-a940-abaf1b0d1048" returned: 0 in 0.335s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Lock "cinder-quobyte-a0697403-d299-41c7-a940-abaf1b0d1048" released by "delete_volume" :: held 0.824s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] 1363cf51-dc8b-4daa-9fac-03256b348aff was raw, converting to qcow2 {{(pid=87124) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:21:56 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Created reservations ['7c93b28c-70b8-4653-9492-2aabc566b13d', '0730cb1a-89bb-49d4-ba54-8c9a7a92993a', '62824d74-2ba1-4cd5-8b7b-4b2bfaedcda5', '416dad5a-374c-4558-9dbd-6a0354ebf130'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Created reservations ['f4f518b4-7327-477c-98d3-7c95ee59060d', '364ab39e-e8ae-4b41-956b-696637150156', '763fd2eb-3763-4e81-aeb2-1587385231f0', '6e67059f-7321-4422-8472-9433f362bcda'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:56 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd Sep 28 15:21:56 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:56 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:56 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.399s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Deleted volume successfully. Sep 28 15:21:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-85bcc780-f915-42d1-9da2-a5a672dcee85 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-4a175f7a-f655-407e-8331-267f30f09417-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:57 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.435s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Deleted volume successfully. Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-47cea217-12f3-4779-ac96-598edabe08a1 tempest-CreateVolumesFromImageTest-1314756423 None] Lock "cinder-f9943fc9-ce76-4a14-ba58-a2577010511c-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:57 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.384s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Deleted volume successfully. Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-02c7fe7e-4546-4c70-bd8b-a7e346e7a21f tempest-VolumeImageDependencyTests-1108637690 None] Lock "cinder-a0697403-d299-41c7-a940-abaf1b0d1048-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:57 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" returned: 0 in 0.758s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1363cf51-dc8b-4daa-9fac-03256b348aff_h0f8vf3ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:21:57 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd 1G Sep 28 15:21:57 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-45026309-89a3-4a83-a88e-d224071f3e1c-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-45026309-89a3-4a83-a88e-d224071f3e1c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-quobyte-45026309-89a3-4a83-a88e-d224071f3e1c" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-45026309-89a3-4a83-a88e-d224071f3e1c" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d931b3c0-de4b-423c-954c-c278da88625e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd 1G" returned: 0 in 0.496s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Downloaded image 1363cf51-dc8b-4daa-9fac-03256b348aff ((None, [{'url': 'file:///opt/stack/data/glance/images/1363cf51-dc8b-4daa-9fac-03256b348aff', 'metadata': {}}])) to volume 48bdd0b2-d9b9-47a5-9529-869c4c03eddd successfully. {{(pid=87124) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Temporary image 1363cf51-dc8b-4daa-9fac-03256b348aff for user f9be953e29f647a29c65c5c5b7c7ed67 is deleted. {{(pid=87124) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.volume_utils [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Marking volume 48bdd0b2-d9b9-47a5-9529-869c4c03eddd as bootable. {{(pid=87124) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Copying metadata from image 1363cf51-dc8b-4daa-9fac-03256b348aff to 48bdd0b2-d9b9-47a5-9529-869c4c03eddd. {{(pid=87124) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Creating volume glance metadata for volume 48bdd0b2-d9b9-47a5-9529-869c4c03eddd backed by image 1363cf51-dc8b-4daa-9fac-03256b348aff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '57e695eb31ade28d237389e35f9b6164', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87124) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:21:57 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c Sep 28 15:21:57 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccf2e1c-4d81-4f09-a5e5-ca32b4b3bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd', 'volume_size': 1, 'image_id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1363cf51-dc8b-4daa-9fac-03256b348aff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57e695eb31ade28d237389e35f9b6164', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46fb400a1437449d9b4666c79f683e4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '962dee2eebbcdbe0df421e24ac9cf621771750c22eab61066607818dec4b44cf8801cd0986ac08ec66b8acc38624d7ad858ed59c95cbf294d9d2545c7d5d28b2', 'id': '1363cf51-dc8b-4daa-9fac-03256b348aff', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1363cf51-dc8b-4daa-9fac-03256b348aff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e07244-75bc-4dcb-a52d-89ddbe795807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Volume volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd (48bdd0b2-d9b9-47a5-9529-869c4c03eddd): created successfully Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e07244-75bc-4dcb-a52d-89ddbe795807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Flow 'volume_create_manager' (6f14a27b-4ff6-4139-ac07-bf533cf4bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-445d6d8f-03a5-4e1e-a3b4-25284dbc820f tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Created volume successfully. Sep 28 15:21:58 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c" returned: 0 in 0.538s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c Sep 28 15:21:58 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:58 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-45026309-89a3-4a83-a88e-d224071f3e1c" returned: 0 in 0.286s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-45026309-89a3-4a83-a88e-d224071f3e1c" released by "delete_volume" :: held 0.892s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created reservations ['100e29ab-607d-494a-a9b4-a01f11d8f978', 'd425efb8-4a2c-4965-a4b6-2d4fe0febfeb', '3acf0a7f-9422-4d2c-a8e4-ae857e83b17b', 'aee3869f-46c2-4bd4-8bfe-c1ebd56ab02e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:21:58 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:59 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Acquiring lock "cinder-48bdd0b2-d9b9-47a5-9529-869c4c03eddd-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.329s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:59 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Deleted volume successfully. Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "cinder-48bdd0b2-d9b9-47a5-9529-869c4c03eddd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2320200a-772d-4cca-8270-b71d40b4d3db tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-45026309-89a3-4a83-a88e-d224071f3e1c-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Acquiring lock "cinder-quobyte-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "cinder-quobyte-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f271cb7-ebfd-4e17-a4b5-cb83b2b66ff8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:59 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd Sep 28 15:21:59 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:59 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" returned: 0 in 0.499s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:59 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd Sep 28 15:21:59 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-28798d01-d16b-4e36-baa7-35a4a52a819b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-28798d01-d16b-4e36-baa7-35a4a52a819b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-quobyte-28798d01-d16b-4e36-baa7-35a4a52a819b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-28798d01-d16b-4e36-baa7-35a4a52a819b" acquired by "delete_volume" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a8b323-95c9-44c8-9edd-d803819ad950]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" returned: 0 in 0.338s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "cinder-quobyte-48bdd0b2-d9b9-47a5-9529-869c4c03eddd" released by "delete_volume" :: held 0.897s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Created reservations ['51007e4b-ac24-4e58-a7bc-ff027433b023', '77ddc383-607e-48df-8136-51ab9265a3c6', 'bcc3b052-6793-4ac9-affc-db72cef8aecc', '237e0228-2f07-4c36-b1eb-94e5cc531d5f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:00 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b Sep 28 15:22:00 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:00 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b" returned: 0 in 0.533s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b Sep 28 15:22:00 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.470s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Deleted volume successfully. Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3325a914-3866-49eb-892e-c5dbb0db16f4 tempest-VolumeAndVolumeTypeFromImageTest-1676850055 None] Lock "cinder-48bdd0b2-d9b9-47a5-9529-869c4c03eddd-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:00 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-28798d01-d16b-4e36-baa7-35a4a52a819b" returned: 0 in 0.363s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-28798d01-d16b-4e36-baa7-35a4a52a819b" released by "delete_volume" :: held 0.967s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created reservations ['46ba11d5-788f-4bdf-88e0-60840a8e560d', 'a4cca702-8482-46a1-900b-37f2078f53a1', 'e7a29fc5-fe85-4047-93f7-3744addc7af8', 'a8e59a6d-2c93-4f8c-8fe8-a32a27d7c6f2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:01 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (1a498f44-de85-42b6-a0d5-d43ad8667484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dcf7cb-81f8-4594-8374-6d2409a21c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dcf7cb-81f8-4594-8374-6d2409a21c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-660418121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79467269-06d3-4cf2-8102-f7b8e37693c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:01Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2363be1-ba6c-4409-adbc-73a5323e76ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2363be1-ba6c-4409-adbc-73a5323e76ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dd2fbb-0504-46c2-9092-69b9067d7258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dd2fbb-0504-46c2-9092-69b9067d7258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79467269-06d3-4cf2-8102-f7b8e37693c3', 'volume_name': 'volume-79467269-06d3-4cf2-8102-f7b8e37693c3', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c702de2-a5e5-448e-aa44-5813c271d38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c702de2-a5e5-448e-aa44-5813c271d38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1c95a9-df66-45a7-95a5-1449e2268b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume 79467269-06d3-4cf2-8102-f7b8e37693c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79467269-06d3-4cf2-8102-f7b8e37693c3', 'volume_size': 1} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-660418121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79467269-06d3-4cf2-8102-f7b8e37693c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:01Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating volume 79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:01 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 1073741824 Sep 28 15:22:01 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.392s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Deleted volume successfully. Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a56f988b-f44d-4507-980a-b5a5ca9c50cb tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-28798d01-d16b-4e36-baa7-35a4a52a819b-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:01 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 1073741824" returned: 0 in 0.587s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:02 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 Sep 28 15:22:02 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-6e6b4532-44a8-4977-85fe-d40f04f6ad46-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-6e6b4532-44a8-4977-85fe-d40f04f6ad46-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:02 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3" returned: 0 in 0.337s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-quobyte-6e6b4532-44a8-4977-85fe-d40f04f6ad46" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1c95a9-df66-45a7-95a5-1449e2268b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79467269-06d3-4cf2-8102-f7b8e37693c3', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07967c07-25ef-43e6-88e4-475c6ef5d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-6e6b4532-44a8-4977-85fe-d40f04f6ad46" acquired by "delete_volume" :: waited 0.037s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume volume-79467269-06d3-4cf2-8102-f7b8e37693c3 (79467269-06d3-4cf2-8102-f7b8e37693c3): created successfully Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07967c07-25ef-43e6-88e4-475c6ef5d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (1a498f44-de85-42b6-a0d5-d43ad8667484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62bf03-53e8-4800-b648-6b52ef03cb94]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c5965e81-d854-4fd0-ae1b-eed4c24ddd35 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created volume successfully. Sep 28 15:22:02 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 Sep 28 15:22:02 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:02 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:02 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46 Sep 28 15:22:02 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6e6b4532-44a8-4977-85fe-d40f04f6ad46" returned: 0 in 0.329s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-6e6b4532-44a8-4977-85fe-d40f04f6ad46" released by "delete_volume" :: held 0.880s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created reservations ['f4eb279d-10d6-43d0-a88c-e46323c56eb9', '9c648958-69b3-4d51-bb5b-efa7504ada3d', '0edba83d-0535-4e85-8147-09f69e329104', '35820c3c-0cf1-4937-a2bc-8ababf61e327'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:03 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating offline snapshot b7f43bad-223e-41f9-815c-fb78bbc3a273 of volume 79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba65a89-4f7e-4cbd-a905-2313ae503362]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.308s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Deleted volume successfully. Sep 28 15:22:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5d0e51b4-659c-42cb-a086-c2a43c65d8a8 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-6e6b4532-44a8-4977-85fe-d40f04f6ad46-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:03 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 Sep 28 15:22:03 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:04 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:04 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 1G Sep 28 15:22:04 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-af813f4f-d562-414b-87c1-e57a01ab5c82-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-af813f4f-d562-414b-87c1-e57a01ab5c82-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-quobyte-af813f4f-d562-414b-87c1-e57a01ab5c82" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-af813f4f-d562-414b-87c1-e57a01ab5c82" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[01298d09-207b-4da5-825e-a174fafed1f4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:04 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 1G" returned: 0 in 0.566s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79467269-06d3-4cf2-8102-f7b8e37693c3 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:04 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79467269-06d3-4cf2-8102-f7b8e37693c3 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 Sep 28 15:22:04 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:04 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 Sep 28 15:22:04 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79467269-06d3-4cf2-8102-f7b8e37693c3 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273" returned: 0 in 0.437s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 is being set with open permissions: ugo+rw Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 Sep 28 15:22:05 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82" returned: 0 in 0.484s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82 Sep 28 15:22:05 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273" returned: 0 in 0.365s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-af813f4f-d562-414b-87c1-e57a01ab5c82" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-af813f4f-d562-414b-87c1-e57a01ab5c82" released by "delete_volume" :: held 0.917s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info Sep 28 15:22:05 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created reservations ['d327b586-c176-4879-b79a-8fc837bde523', '1dc8a39b-9e66-4529-93d5-3aed07d13911', '329db53f-b94c-41c7-a1d8-383c7d888386', '78260219-38fe-4a8a-98cc-642383b93cd8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:05 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info" returned: 0 in 0.384s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info is being set with open permissions: ugo+rw Sep 28 15:22:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info Sep 28 15:22:05 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.261s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Deleted volume successfully. Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0411c9d1-2d6a-45eb-9291-638f0ec38c3a tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-af813f4f-d562-414b-87c1-e57a01ab5c82-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:06 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.info" returned: 0 in 0.266s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8874aa1d-c309-4428-ab21-da623a688245 tempest-CreateVolumesFromSnapshotTest-966050744 None] Create snapshot completed successfully Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Flow 'volume_create_manager' (1f8c54c7-7e6d-48d5-87d2-cc1d80ba05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760b0bd5-b895-489a-b427-051cb5563725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760b0bd5-b895-489a-b427-051cb5563725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7793a5e-b325-4905-8183-8302af5ee766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5da76d0aec343bd910f00dedf16b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:06Z,use_quota=True,user_id='79a0e1a3a00b467bbfa905fd6eba57c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f189b53e-5308-46b5-bfb2-b48f175082df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f189b53e-5308-46b5-bfb2-b48f175082df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8a7859-67c8-491c-a830-2becea0fae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8a7859-67c8-491c-a830-2becea0fae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7793a5e-b325-4905-8183-8302af5ee766', 'volume_name': 'volume-a7793a5e-b325-4905-8183-8302af5ee766', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b799c569-309b-472d-8cb3-1a9c9bc8bbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b799c569-309b-472d-8cb3-1a9c9bc8bbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5234888a-0fb2-475d-9e3d-107a1b08a1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Volume a7793a5e-b325-4905-8183-8302af5ee766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7793a5e-b325-4905-8183-8302af5ee766', 'volume_size': 1} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7793a5e-b325-4905-8183-8302af5ee766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5da76d0aec343bd910f00dedf16b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:06Z,use_quota=True,user_id='79a0e1a3a00b467bbfa905fd6eba57c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Creating volume a7793a5e-b325-4905-8183-8302af5ee766 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:06 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 1073741824 Sep 28 15:22:06 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-1e6784c7-395b-41b9-90a2-d255102e6225-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-1e6784c7-395b-41b9-90a2-d255102e6225-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "cinder-quobyte-1e6784c7-395b-41b9-90a2-d255102e6225" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-1e6784c7-395b-41b9-90a2-d255102e6225" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b577745c-7370-494a-8185-ef8dea9db0f1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 Sep 28 15:22:07 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 1073741824" returned: 0 in 0.574s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 Sep 28 15:22:07 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766" returned: 0 in 0.309s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5234888a-0fb2-475d-9e3d-107a1b08a1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7793a5e-b325-4905-8183-8302af5ee766', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb41b14-29a1-4421-bd93-92e7a21a9a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225" returned: 0 in 0.626s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Volume volume-a7793a5e-b325-4905-8183-8302af5ee766 (a7793a5e-b325-4905-8183-8302af5ee766): created successfully Sep 28 15:22:07 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225 Sep 28 15:22:07 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb41b14-29a1-4421-bd93-92e7a21a9a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Flow 'volume_create_manager' (1f8c54c7-7e6d-48d5-87d2-cc1d80ba05eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (edf12e86-e325-4af0-95c5-6cc16ac3263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05f55dc-3531-4da3-93d8-8298996d2536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ce0950d6-b492-4e1e-857f-b8513541bd80 tempest-CinderUnicodeTest-1387645165 None] Created volume successfully. Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05f55dc-3531-4da3-93d8-8298996d2536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407364882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9d94f6-8881-4c2b-b6b2-8e54f3321685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:08Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729eb2c8-a228-4d8b-bbea-101405c61244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729eb2c8-a228-4d8b-bbea-101405c61244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6448fcf7-c3b9-41f3-b909-c4c671a32a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6448fcf7-c3b9-41f3-b909-c4c671a32a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9d94f6-8881-4c2b-b6b2-8e54f3321685', 'volume_name': 'volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137c80ae-1b65-4414-ad09-0bb85620c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137c80ae-1b65-4414-ad09-0bb85620c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0620826e-61c4-4db1-b6d2-67eec330cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume bd9d94f6-8881-4c2b-b6b2-8e54f3321685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685', 'volume_size': 1} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407364882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9d94f6-8881-4c2b-b6b2-8e54f3321685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:08Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating volume bd9d94f6-8881-4c2b-b6b2-8e54f3321685 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:07 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 1073741824 Sep 28 15:22:07 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-1e6784c7-395b-41b9-90a2-d255102e6225" returned: 0 in 0.359s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-quobyte-1e6784c7-395b-41b9-90a2-d255102e6225" released by "delete_volume" :: held 1.046s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Created reservations ['c681787c-d0f6-4194-a0a6-864caf887912', '2accf28d-2ac2-4a9e-804d-ff5b7451ad46', 'de69c3b1-a799-41f8-821b-7d896825b898', 'ea923b1a-5b5e-4f5f-bd23-d4bd8ab516e2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:08 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.311s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:08 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Deleted volume successfully. Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 1073741824" returned: 0 in 0.645s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (8fedfafa-ffbb-49ab-b353-bb118407f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62cd4a6-db0b-4311-96a6-98397b440722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b424866b-190c-4c50-863b-0c40ff249ee2 tempest-CreateVolumesFromSourceVolumeTest-656413225 None] Lock "cinder-1e6784c7-395b-41b9-90a2-d255102e6225-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62cd4a6-db0b-4311-96a6-98397b440722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312384348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964f4c7c-6e00-42e8-9f64-1bd0764ab1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:08Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dadda1cf-ebc8-4f34-8a48-d694af721864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dadda1cf-ebc8-4f34-8a48-d694af721864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174a6fa5-f0cc-42ce-a3c6-39632ac4f26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174a6fa5-f0cc-42ce-a3c6-39632ac4f26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964f4c7c-6e00-42e8-9f64-1bd0764ab1c8', 'volume_name': 'volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ded78b-62ae-47f8-bd99-5ea76afc4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ded78b-62ae-47f8-bd99-5ea76afc4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad254dd6-0764-4817-a536-c52071c620c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume 964f4c7c-6e00-42e8-9f64-1bd0764ab1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8', 'volume_size': 1} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:08 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (1e80e38a-b016-450a-9ba8-a5d4f24f4ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:08 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b58843-78aa-4af5-bdc5-bde9ba1833fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b58843-78aa-4af5-bdc5-bde9ba1833fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1135346470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923766ea-bdcf-4739-8dc9-efdbe90e9e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:09Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2952c1a-7b91-4c92-a184-3c35abdc0b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2952c1a-7b91-4c92-a184-3c35abdc0b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a972d7c2-b4fd-44c2-948b-dcb10e7699da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a972d7c2-b4fd-44c2-948b-dcb10e7699da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923766ea-bdcf-4739-8dc9-efdbe90e9e3d', 'volume_name': 'volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5d6b62-4cde-4029-a8c5-482fa1b83e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5d6b62-4cde-4029-a8c5-482fa1b83e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f31146-3f1d-4f29-8967-f9da291fea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume 923766ea-bdcf-4739-8dc9-efdbe90e9e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d', 'volume_size': 1} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (bfa8993f-e6d2-4df1-9b90-9e2615d974ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:08 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8467f96b-4e35-4600-b9c8-def5c94dac7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8467f96b-4e35-4600-b9c8-def5c94dac7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579610743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bde93e-c0c7-4e59-ba69-3af1d718f239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:09Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5632154-f36c-4618-bfff-c9526428b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5632154-f36c-4618-bfff-c9526428b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b025ed-63ee-4115-9f56-e767be124d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b025ed-63ee-4115-9f56-e767be124d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bde93e-c0c7-4e59-ba69-3af1d718f239', 'volume_name': 'volume-58bde93e-c0c7-4e59-ba69-3af1d718f239', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9dddd5-adb0-48a0-9527-cd9fbf24fa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9dddd5-adb0-48a0-9527-cd9fbf24fa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe91ce57-87cc-44bc-9b0a-418bacdfc91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume 58bde93e-c0c7-4e59-ba69-3af1d718f239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bde93e-c0c7-4e59-ba69-3af1d718f239', 'volume_size': 1} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685" returned: 0 in 0.393s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312384348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964f4c7c-6e00-42e8-9f64-1bd0764ab1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:08Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating volume 964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:09 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0620826e-61c4-4db1-b6d2-67eec330cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 1073741824 Sep 28 15:22:09 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f64d470-5de5-4bf9-b748-05fee879d056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 (bd9d94f6-8881-4c2b-b6b2-8e54f3321685): created successfully Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f64d470-5de5-4bf9-b748-05fee879d056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (edf12e86-e325-4af0-95c5-6cc16ac3263f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-70d84a47-a25c-4c00-a5f3-f111b609684c tempest-CreateVolumesFromSnapshotTest-966050744 None] Created volume successfully. Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (00155fb9-c1c3-4569-94c9-ff96c0d5320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbb6ca9-19fa-455a-bfa4-59c83ba400e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbb6ca9-19fa-455a-bfa4-59c83ba400e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903314692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fa10eb-13cd-4815-8f9e-8d27e5540499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:10Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbecffdf-9efb-4984-8d56-1fe1a0ee08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbecffdf-9efb-4984-8d56-1fe1a0ee08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406049ea-8742-4c21-8987-2b9c8324acac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406049ea-8742-4c21-8987-2b9c8324acac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29fa10eb-13cd-4815-8f9e-8d27e5540499', 'volume_name': 'volume-29fa10eb-13cd-4815-8f9e-8d27e5540499', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535c1c6e-4f33-4957-9e42-1b2b230ca955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535c1c6e-4f33-4957-9e42-1b2b230ca955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3f425d-324d-46a7-bd83-984060d5ca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume 29fa10eb-13cd-4815-8f9e-8d27e5540499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29fa10eb-13cd-4815-8f9e-8d27e5540499', 'volume_size': 1} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 1073741824" returned: 0 in 0.873s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Flow 'volume_create_manager' (ba0e8568-1996-4458-aa9a-f29bcf6e2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:09 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b940e8-9ec9-47eb-9bc6-7bb432d57e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b940e8-9ec9-47eb-9bc6-7bb432d57e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1566639715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6539e0bd-b222-4b0d-b904-d311acd171ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5da76d0aec343bd910f00dedf16b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:10Z,use_quota=True,user_id='79a0e1a3a00b467bbfa905fd6eba57c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac302495-2a98-4f07-b52d-45c222f70559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac302495-2a98-4f07-b52d-45c222f70559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661ddf8e-47ae-4c4a-9c88-adba9b8a7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661ddf8e-47ae-4c4a-9c88-adba9b8a7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6539e0bd-b222-4b0d-b904-d311acd171ba', 'volume_name': 'volume-6539e0bd-b222-4b0d-b904-d311acd171ba', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7871fe1-2563-4c45-a80d-0d6fc3c6555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7871fe1-2563-4c45-a80d-0d6fc3c6555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcebc84-c967-4289-a1be-8b3e63037e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Volume 6539e0bd-b222-4b0d-b904-d311acd171ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6539e0bd-b222-4b0d-b904-d311acd171ba', 'volume_size': 1} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 Sep 28 15:22:10 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8" returned: 0 in 0.272s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1135346470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923766ea-bdcf-4739-8dc9-efdbe90e9e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:09Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating volume 923766ea-bdcf-4739-8dc9-efdbe90e9e3d {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:10 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad254dd6-0764-4817-a536-c52071c620c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d 1073741824 Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4467438d-d83e-418d-a529-eedf83d4287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 (964f4c7c-6e00-42e8-9f64-1bd0764ab1c8): created successfully Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4467438d-d83e-418d-a529-eedf83d4287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (8fedfafa-ffbb-49ab-b353-bb118407f726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-c169a333-5176-4088-883b-580379f369b3 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created volume successfully. Sep 28 15:22:11 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d 1073741824" returned: 0 in 0.674s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d Sep 28 15:22:11 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d" returned: 0 in 0.290s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579610743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bde93e-c0c7-4e59-ba69-3af1d718f239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:09Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating volume 58bde93e-c0c7-4e59-ba69-3af1d718f239 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:11 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f31146-3f1d-4f29-8967-f9da291fea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:11 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 1073741824 Sep 28 15:22:11 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600bd613-119f-4927-bd6a-f2e6d7907a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:11 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d (923766ea-bdcf-4739-8dc9-efdbe90e9e3d): created successfully Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600bd613-119f-4927-bd6a-f2e6d7907a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (1e80e38a-b016-450a-9ba8-a5d4f24f4ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:11 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2fe97140-114e-40a4-a45f-e3fbd89deccc tempest-CreateVolumesFromSnapshotTest-966050744 None] Created volume successfully. Sep 28 15:22:12 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 1073741824" returned: 0 in 0.637s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 Sep 28 15:22:12 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:12 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239" returned: 0 in 0.310s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903314692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fa10eb-13cd-4815-8f9e-8d27e5540499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2cb7cdce2340b58b9957cf853d0747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:10Z,use_quota=True,user_id='3481f89742c24eb29688313dec971260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Creating volume 29fa10eb-13cd-4815-8f9e-8d27e5540499 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:12 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe91ce57-87cc-44bc-9b0a-418bacdfc91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bde93e-c0c7-4e59-ba69-3af1d718f239', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:12 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 1073741824 Sep 28 15:22:12 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7ce96b-c479-4cba-8a85-5a988404a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:12 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 (58bde93e-c0c7-4e59-ba69-3af1d718f239): created successfully Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7ce96b-c479-4cba-8a85-5a988404a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (bfa8993f-e6d2-4df1-9b90-9e2615d974ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-faafdba3-efea-4cf4-92f6-62d0dcad3562 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created volume successfully. Sep 28 15:22:12 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 1073741824" returned: 0 in 0.547s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 Sep 28 15:22:13 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499" returned: 0 in 0.269s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.221s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1566639715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6539e0bd-b222-4b0d-b904-d311acd171ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5da76d0aec343bd910f00dedf16b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:10Z,use_quota=True,user_id='79a0e1a3a00b467bbfa905fd6eba57c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Creating volume 6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:13 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3f425d-324d-46a7-bd83-984060d5ca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29fa10eb-13cd-4815-8f9e-8d27e5540499', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48421886-213c-427f-9760-142683bd29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:13 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba 1073741824 Sep 28 15:22:13 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Volume volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 (29fa10eb-13cd-4815-8f9e-8d27e5540499): created successfully Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48421886-213c-427f-9760-142683bd29fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Flow 'volume_create_manager' (00155fb9-c1c3-4569-94c9-ff96c0d5320b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:13 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-06eac609-cfeb-4b77-b52c-e4b6acc938ca tempest-CreateVolumesFromSnapshotTest-966050744 None] Created volume successfully. Sep 28 15:22:13 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba 1073741824" returned: 0 in 0.572s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba Sep 28 15:22:13 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-29fa10eb-13cd-4815-8f9e-8d27e5540499-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-29fa10eb-13cd-4815-8f9e-8d27e5540499-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-29fa10eb-13cd-4815-8f9e-8d27e5540499" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-29fa10eb-13cd-4815-8f9e-8d27e5540499" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:14 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba" returned: 0 in 0.314s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563c2d1-abd0-45db-aeac-bd320c3451fd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcebc84-c967-4289-a1be-8b3e63037e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6539e0bd-b222-4b0d-b904-d311acd171ba', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3414a3c-164d-4342-8118-37f76b3d6fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Volume volume-6539e0bd-b222-4b0d-b904-d311acd171ba (6539e0bd-b222-4b0d-b904-d311acd171ba): created successfully Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3414a3c-164d-4342-8118-37f76b3d6fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Flow 'volume_create_manager' (ba0e8568-1996-4458-aa9a-f29bcf6e2c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3d84cfd3-20c8-422c-9d17-a173714847bc tempest-CinderUnicodeTest-1387645165 None] Created volume successfully. Sep 28 15:22:14 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 Sep 28 15:22:14 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:14 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499" returned: 0 in 0.459s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:14 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499 Sep 28 15:22:14 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:15 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-29fa10eb-13cd-4815-8f9e-8d27e5540499" returned: 0 in 0.335s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-29fa10eb-13cd-4815-8f9e-8d27e5540499" released by "delete_volume" :: held 0.862s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['92782c2e-54a1-4912-be6a-25ab4528676a', '816132d0-b1b8-437c-916b-a2d9cb7a7e48', 'c0a34034-7fcd-4416-a3f2-2ff75d9bc2f8', 'd4af01e3-3c95-4260-a55d-8ea689a1308b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Flow 'volume_create_manager' (312ebd8b-0f66-4d9e-b1f3-2d588ac5fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c646f08-b3c4-4f8b-94c3-78f0d405119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c646f08-b3c4-4f8b-94c3-78f0d405119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341172267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf282bd-3e56-4352-9cb1-33aca7198095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63b8c063a0e457abebc240135bb5a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:15Z,use_quota=True,user_id='0ed0440c328448adaafe50c48cdd9763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30ebe47-517d-469e-a643-09ab7a75305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30ebe47-517d-469e-a643-09ab7a75305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ca6114-d51f-4afe-927c-3751504a99dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ca6114-d51f-4afe-927c-3751504a99dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf282bd-3e56-4352-9cb1-33aca7198095', 'volume_name': 'volume-fbf282bd-3e56-4352-9cb1-33aca7198095', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984cb084-7d0e-47b0-b8a8-cede844b505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984cb084-7d0e-47b0-b8a8-cede844b505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb5237d-fa0f-483a-a52a-2b2b64d6b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:15 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Volume fbf282bd-3e56-4352-9cb1-33aca7198095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf282bd-3e56-4352-9cb1-33aca7198095', 'volume_size': 1} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341172267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf282bd-3e56-4352-9cb1-33aca7198095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63b8c063a0e457abebc240135bb5a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:15Z,use_quota=True,user_id='0ed0440c328448adaafe50c48cdd9763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Creating volume fbf282bd-3e56-4352-9cb1-33aca7198095 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:15 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-58bde93e-c0c7-4e59-ba69-3af1d718f239-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:15 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 1073741824 Sep 28 15:22:15 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-58bde93e-c0c7-4e59-ba69-3af1d718f239-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-58bde93e-c0c7-4e59-ba69-3af1d718f239" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:15 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:15 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-58bde93e-c0c7-4e59-ba69-3af1d718f239" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5c6cb5-64d1-47c4-b823-1a919f9a80da]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:15 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 Sep 28 15:22:15 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:15 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.302s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleted volume successfully. Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-0b2dc8ff-af65-4dee-b68b-286aa3360204 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-29fa10eb-13cd-4815-8f9e-8d27e5540499-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:15 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 1073741824" returned: 0 in 0.605s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 Sep 28 15:22:16 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239" returned: 0 in 0.519s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239 Sep 28 15:22:16 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095" returned: 0 in 0.263s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.781s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb5237d-fa0f-483a-a52a-2b2b64d6b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf282bd-3e56-4352-9cb1-33aca7198095', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d5557c-ed5d-4b03-b907-a98c231bd03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Creating offline snapshot 9aafb191-8a67-4f26-93f3-fe382d3bcc53 of volume 6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:16 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Volume volume-fbf282bd-3e56-4352-9cb1-33aca7198095 (fbf282bd-3e56-4352-9cb1-33aca7198095): created successfully Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d5557c-ed5d-4b03-b907-a98c231bd03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Flow 'volume_create_manager' (312ebd8b-0f66-4d9e-b1f3-2d588ac5fad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[88036a18-3222-465b-9d20-fbb24ebfec29]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-93d26025-df97-4f4b-ad47-4b81af45b56c tempest-ProjectReaderTests-434395782 None] Created volume successfully. Sep 28 15:22:16 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba Sep 28 15:22:16 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-58bde93e-c0c7-4e59-ba69-3af1d718f239" returned: 0 in 0.375s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-58bde93e-c0c7-4e59-ba69-3af1d718f239" released by "delete_volume" :: held 0.962s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['c9403941-f36e-415c-b36a-921523c098e0', '9a116a31-0c73-4c32-98c9-3ab8863030f6', '82dde100-f4e5-43b4-b4fe-b821e2bf778a', 'dec14bcb-2dc1-4b8f-87f9-00457af60745'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:16 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba" returned: 0 in 0.463s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 1G Sep 28 15:22:16 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.269s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleted volume successfully. Sep 28 15:22:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f7ef6580-77ef-4094-a64c-45a60b588d9f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-58bde93e-c0c7-4e59-ba69-3af1d718f239-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:17 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 1G" returned: 0 in 0.509s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6539e0bd-b222-4b0d-b904-d311acd171ba -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:17 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6539e0bd-b222-4b0d-b904-d311acd171ba -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 Sep 28 15:22:17 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-923766ea-bdcf-4739-8dc9-efdbe90e9e3d-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Acquiring lock "cinder-fbf282bd-3e56-4352-9cb1-33aca7198095-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Lock "cinder-fbf282bd-3e56-4352-9cb1-33aca7198095-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-923766ea-bdcf-4739-8dc9-efdbe90e9e3d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:17 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6539e0bd-b222-4b0d-b904-d311acd171ba -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:17 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 is being set with open permissions: ugo+rw Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Acquiring lock "cinder-quobyte-fbf282bd-3e56-4352-9cb1-33aca7198095" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:17 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 Sep 28 15:22:17 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-923766ea-bdcf-4739-8dc9-efdbe90e9e3d" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Lock "cinder-quobyte-fbf282bd-3e56-4352-9cb1-33aca7198095" acquired by "delete_volume" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-923766ea-bdcf-4739-8dc9-efdbe90e9e3d" acquired by "delete_volume" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce55370c-a330-40ab-b1f1-ec3233224c99]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab30740-8e9d-4b2a-8559-878924f14591]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:17 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 Sep 28 15:22:17 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d Sep 28 15:22:17 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:17 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53" returned: 0 in 0.339s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:18 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info Sep 28 15:22:18 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095" returned: 0 in 0.475s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:18 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095 Sep 28 15:22:18 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d" returned: 0 in 0.514s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:18 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d Sep 28 15:22:18 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info" returned: 0 in 0.384s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info is being set with open permissions: ugo+rw Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:18 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info Sep 28 15:22:18 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-fbf282bd-3e56-4352-9cb1-33aca7198095" returned: 0 in 0.319s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Lock "cinder-quobyte-fbf282bd-3e56-4352-9cb1-33aca7198095" released by "delete_volume" :: held 0.853s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:18 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-923766ea-bdcf-4739-8dc9-efdbe90e9e3d" returned: 0 in 0.342s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-923766ea-bdcf-4739-8dc9-efdbe90e9e3d" released by "delete_volume" :: held 0.910s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Created reservations ['14e2128d-b58d-4521-9d92-87f337e39300', 'eb5fa573-66fb-486a-b5da-6e6435bf1837', '56abe6e7-6991-465f-952c-d5a100c7e739', 'c386dc87-9bf1-4bfb-8309-a244ccf830d5'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['2fcfbb6d-3e49-43bf-8b32-e89958953e1e', '808afe9c-da8c-487d-94ae-23645d3af862', 'a408b2ac-ea93-4e8d-adf9-d949b33fa7ae', 'a5b2fd38-66e2-43a5-bf86-5c6598962e5f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:18 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.info" returned: 0 in 0.373s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:18 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:18 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-643ebe53-ef5e-402d-9dc8-ecbacc4e5ed6 tempest-CinderUnicodeTest-1387645165 None] Create snapshot completed successfully Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:19 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:19 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:19 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.306s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Deleted volume successfully. Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-6cac1927-29da-46a6-8838-68d67a95eace tempest-ProjectReaderTests-434395782 None] Lock "cinder-fbf282bd-3e56-4352-9cb1-33aca7198095-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:19 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.290s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleted volume successfully. Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-adf73ad5-5028-4146-82fc-67046491b17f tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-923766ea-bdcf-4739-8dc9-efdbe90e9e3d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-9aafb191-8a67-4f26-93f3-fe382d3bcc53-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-9aafb191-8a67-4f26-93f3-fe382d3bcc53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-quobyte-6539e0bd-b222-4b0d-b904-d311acd171ba" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-6539e0bd-b222-4b0d-b904-d311acd171ba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-quobyte-9aafb191-8a67-4f26-93f3-fe382d3bcc53" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-9aafb191-8a67-4f26-93f3-fe382d3bcc53" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Deleting offline snapshot 9aafb191-8a67-4f26-93f3-fe382d3bcc53 of volume 6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] snapshot_file for this snap is: volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab4b417-3b84-45c2-9c94-5db89b286406]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:19 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 Sep 28 15:22:19 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2073a3-3513-4170-8d6b-d4d5c22ab5cb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:20 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53" returned: 0 in 0.483s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6539e0bd-b222-4b0d-b904-d311acd171ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a7e606-381d-4ee9-8233-11fe48ed9d9e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:20 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 Sep 28 15:22:20 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:20 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba Sep 28 15:22:20 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:20 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Flow 'volume_create_manager' (ead23ebc-725e-4c3e-ba24-ad7df832b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1c3e3e-db8f-4da7-9e3d-1997220441e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8" returned: 0 in 0.471s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1c3e3e-db8f-4da7-9e3d-1997220441e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919246848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63b8c063a0e457abebc240135bb5a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:21Z,use_quota=True,user_id='0ed0440c328448adaafe50c48cdd9763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:20 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8 Sep 28 15:22:20 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bd4df3-6c6a-41a1-b61c-206aac75cfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bd4df3-6c6a-41a1-b61c-206aac75cfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91eb5095-d392-473e-8512-ae7bcb8a3276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91eb5095-d392-473e-8512-ae7bcb8a3276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec', 'volume_name': 'volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6f9c32-e630-425a-929c-57a6fc1204c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6f9c32-e630-425a-929c-57a6fc1204c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b053dd5-c08f-402c-a9f4-96d756b86f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Volume d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec', 'volume_size': 1} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919246848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63b8c063a0e457abebc240135bb5a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:21Z,use_quota=True,user_id='0ed0440c328448adaafe50c48cdd9763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Creating volume d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:20 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:20 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba" returned: 0 in 0.490s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:20 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec 1073741824 Sep 28 15:22:20 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:20 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 Sep 28 15:22:20 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:20 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8" returned: 0 in 0.279s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8" released by "delete_volume" :: held 0.789s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:20 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['2cd2cbbb-bdf8-4602-9501-ef91bae26897', 'fd4bf516-d68c-4f95-a41d-6114f388ae11', '6b020847-f2df-46e1-940e-81f479b57d53', '22be72ab-c570-4fe6-b1dd-cdae542d9b2d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:21 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:21 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:21 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:21 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53 Sep 28 15:22:21 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-bd9d94f6-8881-4c2b-b6b2-8e54f3321685-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-bd9d94f6-8881-4c2b-b6b2-8e54f3321685-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:21 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec 1073741824" returned: 0 in 0.633s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-bd9d94f6-8881-4c2b-b6b2-8e54f3321685" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:21 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-bd9d94f6-8881-4c2b-b6b2-8e54f3321685" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb0bc8-d71a-4b0b-8943-5490eab9feda]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleted volume successfully. Sep 28 15:22:21 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec Sep 28 15:22:21 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8a5c9b7f-5e8c-4ac0-bcce-7c2bc276e128 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-964f4c7c-6e00-42e8-9f64-1bd0764ab1c8-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:21 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba.9aafb191-8a67-4f26-93f3-fe382d3bcc53" returned: 0 in 0.509s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:21 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 Sep 28 15:22:21 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-9aafb191-8a67-4f26-93f3-fe382d3bcc53" released by "_delete_snapshot" :: held 2.078s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-6539e0bd-b222-4b0d-b904-d311acd171ba" released by "delete_snapshot" :: held 2.111s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Created reservations ['039e7640-8ba6-4d01-ae98-d74274543880', '520c398d-9bf8-4db1-bbeb-863b6f18fb97', '9d61a0a7-1eb1-47bc-814e-7cb28b83a85a', '6524e60d-f030-4c79-b585-ca222001244b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:21 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec" returned: 0 in 0.429s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b053dd5-c08f-402c-a9f4-96d756b86f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3644b1-c5dd-4b68-9412-ac1ed8a405a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Delete snapshot completed successfully. Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-033054a0-85f8-4a86-b88b-4bb5288a0e49 tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-9aafb191-8a67-4f26-93f3-fe382d3bcc53-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:21 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Volume volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec (d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec): created successfully Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3644b1-c5dd-4b68-9412-ac1ed8a405a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Flow 'volume_create_manager' (ead23ebc-725e-4c3e-ba24-ad7df832b376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a53537e0-3830-4480-95f6-e7079c2ef0b2 tempest-ProjectReaderTests-434395782 None] Created volume successfully. Sep 28 15:22:22 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685" returned: 0 in 0.527s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:22 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685 Sep 28 15:22:22 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:22 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-bd9d94f6-8881-4c2b-b6b2-8e54f3321685" returned: 0 in 0.289s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-bd9d94f6-8881-4c2b-b6b2-8e54f3321685" released by "delete_volume" :: held 0.910s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['18935b17-5ec8-4413-ad3c-65121a471057', 'ae17e5bc-88c4-47bd-8687-613a9f0869cb', '62edf4f4-e0d8-431f-8dcc-432210c3bdc9', '993743e6-2eef-4b12-9e6c-72d5a32d497e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:22 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:22 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Acquiring lock "cinder-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Lock "cinder-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Acquiring lock "cinder-quobyte-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Lock "cinder-quobyte-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:22 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.296s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7275ce4-99f2-4748-af50-6e238f656e3f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:22 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleted volume successfully. Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-6539e0bd-b222-4b0d-b904-d311acd171ba-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f93b8b12-f606-40f6-a114-734f74649d23 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-bd9d94f6-8881-4c2b-b6b2-8e54f3321685-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-6539e0bd-b222-4b0d-b904-d311acd171ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-quobyte-6539e0bd-b222-4b0d-b904-d311acd171ba" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-6539e0bd-b222-4b0d-b904-d311acd171ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[8664937c-d285-4c10-9bac-d95e008a0450]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:22 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec Sep 28 15:22:22 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba Sep 28 15:22:23 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec" returned: 0 in 0.443s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec Sep 28 15:22:23 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba" returned: 0 in 0.453s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba Sep 28 15:22:23 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec" returned: 0 in 0.283s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Lock "cinder-quobyte-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec" released by "delete_volume" :: held 0.792s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-b7f43bad-223e-41f9-815c-fb78bbc3a273-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-b7f43bad-223e-41f9-815c-fb78bbc3a273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-79467269-06d3-4cf2-8102-f7b8e37693c3" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-79467269-06d3-4cf2-8102-f7b8e37693c3" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-b7f43bad-223e-41f9-815c-fb78bbc3a273" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Created reservations ['ddb0f058-f8ed-4d73-8e3c-716fa416449b', '8ac8111f-c9e5-4fd9-9733-3fff5db4f78c', 'af719482-4476-4ccb-9b7b-e422ada3baaf', 'fb4e0bd4-4110-4634-b21f-73030ed5bd79'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-b7f43bad-223e-41f9-815c-fb78bbc3a273" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleting offline snapshot b7f43bad-223e-41f9-815c-fb78bbc3a273 of volume 79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] snapshot_file for this snap is: volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c89010-2bc7-478a-b2d9-09c1ab8ae761]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-6539e0bd-b222-4b0d-b904-d311acd171ba" returned: 0 in 0.362s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-6539e0bd-b222-4b0d-b904-d311acd171ba" released by "delete_volume" :: held 0.906s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:23 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Created reservations ['2b68258a-7127-4bee-b6ff-588f264ac207', '01a86647-0ceb-4972-a923-a10a683ccc89', 'b3972580-8f84-47ae-bfdd-346331b5b275', '92368275-05bf-4c8e-b9b4-47a7c2700dfc'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:23 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 Sep 28 15:22:23 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:24 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:24 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:24 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.380s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:24 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Deleted volume successfully. Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-024ee3fe-e36a-4a6b-9b4c-c0ef498ca8b3 tempest-ProjectReaderTests-434395782 None] Lock "cinder-d2ea1c51-8b2c-4c2e-93de-a8bbdd6f20ec-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:24 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273" returned: 0 in 0.675s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79467269-06d3-4cf2-8102-f7b8e37693c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[901626b3-633d-459c-9846-7449b7419b2c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:24 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.442s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:24 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Deleted volume successfully. Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f0fd5c55-c0c1-4c1f-b60c-98ed545c2a4b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-6539e0bd-b222-4b0d-b904-d311acd171ba-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:24 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 Sep 28 15:22:24 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:24 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3" returned: 0 in 0.488s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:24 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 Sep 28 15:22:24 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-a7793a5e-b325-4905-8183-8302af5ee766-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-a7793a5e-b325-4905-8183-8302af5ee766-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "cinder-quobyte-a7793a5e-b325-4905-8183-8302af5ee766" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-a7793a5e-b325-4905-8183-8302af5ee766" acquired by "delete_volume" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f055e6-462c-44fe-921f-bf71940a28a0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273" returned: 0 in 0.550s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273 Sep 28 15:22:25 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 Sep 28 15:22:25 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766" returned: 0 in 0.514s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3.b7f43bad-223e-41f9-815c-fb78bbc3a273" returned: 0 in 0.395s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:25 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766 Sep 28 15:22:25 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-b7f43bad-223e-41f9-815c-fb78bbc3a273" released by "_delete_snapshot" :: held 2.283s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-79467269-06d3-4cf2-8102-f7b8e37693c3" released by "delete_snapshot" :: held 2.326s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['b6143ef6-bc79-4bf4-ac2d-80792c9f6418', '4bc20e68-d805-4f9a-a9ca-64205e9f5dd3', '77c4aa55-33f1-4f2d-bd3e-5a5b402b38b5', '438d7049-b05c-46dd-981f-3f868db3d59c'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Delete snapshot completed successfully. Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-41ce49e8-cec2-4142-ac54-59a528598042 tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-b7f43bad-223e-41f9-815c-fb78bbc3a273-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a7793a5e-b325-4905-8183-8302af5ee766" returned: 0 in 0.405s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-quobyte-a7793a5e-b325-4905-8183-8302af5ee766" released by "delete_volume" :: held 0.990s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Created reservations ['6a0a7fdf-2f50-4026-b3c8-620bdd0afe01', 'e26b6764-fb39-41a6-89e7-9e41e023772b', 'b433d762-4a4b-4e18-86d9-ba8f07aa0063', 'd03b1caa-95bb-4c21-893d-b579afc90dc0'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:26 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:26 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.319s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-79467269-06d3-4cf2-8102-f7b8e37693c3-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:26 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Deleted volume successfully. Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-79467269-06d3-4cf2-8102-f7b8e37693c3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9b5d8a4c-66b6-4130-9e0d-cfa0addc715b tempest-CinderUnicodeTest-1387645165 None] Lock "cinder-a7793a5e-b325-4905-8183-8302af5ee766-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "cinder-quobyte-79467269-06d3-4cf2-8102-f7b8e37693c3" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-79467269-06d3-4cf2-8102-f7b8e37693c3" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b7794-3d62-4540-869e-a16c56565f5c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:27 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 Sep 28 15:22:27 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:27 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:27 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3 Sep 28 15:22:27 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:27 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-79467269-06d3-4cf2-8102-f7b8e37693c3" returned: 0 in 0.308s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-quobyte-79467269-06d3-4cf2-8102-f7b8e37693c3" released by "delete_volume" :: held 0.839s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Created reservations ['f908f2c1-dd83-4b92-bb95-b4d7b6ed5fe5', '8965fdaf-89ac-4da2-a868-956dce7fdcd8', 'fde6e9ca-7360-4c8e-a4e5-f609c3dd4bd2', '2611d363-6fad-48aa-9488-9a2f7d068cac'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:28 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.325s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Deleted volume successfully. Sep 28 15:22:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8e6a141f-fd05-40f8-b637-f345745ef91a tempest-CreateVolumesFromSnapshotTest-966050744 None] Lock "cinder-79467269-06d3-4cf2-8102-f7b8e37693c3-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Flow 'volume_create_manager' (f7d057bf-38c5-4969-ab45-1a01422e02f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df613798-8c2c-4658-9f6a-3195b53babe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df613798-8c2c-4658-9f6a-3195b53babe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-961225941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3ef308-f358-40f6-9af4-e5bad8d33705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0634ea6e10e4cf7a87e79573bfcdda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:32Z,use_quota=True,user_id='f55f4405314f456bb4195e397d0e2a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd3a7b7-b0da-4cd2-8b46-36dae7fb1933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd3a7b7-b0da-4cd2-8b46-36dae7fb1933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037f5ec7-5c14-4c8e-b391-e5467414a86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037f5ec7-5c14-4c8e-b391-e5467414a86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3ef308-f358-40f6-9af4-e5bad8d33705', 'volume_name': 'volume-ee3ef308-f358-40f6-9af4-e5bad8d33705', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75d4470-00d4-4b2d-a5c8-6682032d103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75d4470-00d4-4b2d-a5c8-6682032d103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0a3b7e-9caa-41b9-aad9-cb1494ecc54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Volume ee3ef308-f358-40f6-9af4-e5bad8d33705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3ef308-f358-40f6-9af4-e5bad8d33705', 'volume_size': 1} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-961225941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3ef308-f358-40f6-9af4-e5bad8d33705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0634ea6e10e4cf7a87e79573bfcdda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:32Z,use_quota=True,user_id='f55f4405314f456bb4195e397d0e2a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Creating volume ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:32 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:32 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 1073741824 Sep 28 15:22:32 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:32 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 1073741824" returned: 0 in 0.547s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 Sep 28 15:22:33 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705" returned: 0 in 0.352s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0a3b7e-9caa-41b9-aad9-cb1494ecc54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3ef308-f358-40f6-9af4-e5bad8d33705', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42353769-1bbd-436b-a67f-de178af9c2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Volume volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 (ee3ef308-f358-40f6-9af4-e5bad8d33705): created successfully Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42353769-1bbd-436b-a67f-de178af9c2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Flow 'volume_create_manager' (f7d057bf-38c5-4969-ab45-1a01422e02f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-99c2db05-a7f9-4373-8386-484b7812f36c tempest-VolumeDependencyTests-793285182 None] Created volume successfully. Sep 28 15:22:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-2aefbf55-49cf-4deb-8e78-55b678ee8849 tempest-ProjectAdminTests-217412021 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87124) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:22:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Creating offline snapshot f75bfbfb-b218-479b-a270-d9365fb7c221 of volume ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:34 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a0ab6-2cb9-4017-8960-853c50e01b62]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:34 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 Sep 28 15:22:34 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:35 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705" returned: 0 in 0.436s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:35 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 1G Sep 28 15:22:35 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:35 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 1G" returned: 0 in 0.520s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:35 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 Sep 28 15:22:35 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:35 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221" returned: 0 in 0.317s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:35 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 is being set with open permissions: ugo+rw Sep 28 15:22:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:35 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 Sep 28 15:22:35 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221" returned: 0 in 0.276s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=268,cinder:SELECT=191,cinder:INSERT=67,cinder:DELETE=26 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=198,cinder:UPDATE=279,cinder:DELETE=23,cinder:INSERT=78 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info Sep 28 15:22:36 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info" returned: 0 in 0.315s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info is being set with open permissions: ugo+rw Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info Sep 28 15:22:36 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.info" returned: 0 in 0.288s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:36 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4224eefe-eb45-499a-aa2c-4e2cf29fe78b tempest-VolumeDependencyTests-793285182 None] Create snapshot completed successfully Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (edb9a291-9833-45b7-b4e2-4213dfa8598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26086b41-5cff-4c49-acf9-810b23a2c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26086b41-5cff-4c49-acf9-810b23a2c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325426406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d52566-b542-4355-976a-ed6c101d75b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:37Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc054f1-20e1-4814-bf49-d3127183429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc054f1-20e1-4814-bf49-d3127183429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72c5b38-0dfa-47f6-80cd-e0decd2584d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72c5b38-0dfa-47f6-80cd-e0decd2584d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d52566-b542-4355-976a-ed6c101d75b6', 'volume_name': 'volume-38d52566-b542-4355-976a-ed6c101d75b6', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419d7748-f614-41d5-9598-e3c0883e4131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419d7748-f614-41d5-9598-e3c0883e4131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112baf38-61ba-475f-aac3-3214622b32d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Volume 38d52566-b542-4355-976a-ed6c101d75b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d52566-b542-4355-976a-ed6c101d75b6', 'volume_size': 1} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325426406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d52566-b542-4355-976a-ed6c101d75b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:37Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Creating volume 38d52566-b542-4355-976a-ed6c101d75b6 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:37 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 1073741824 Sep 28 15:22:37 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:37 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.324s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:22:37 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 1073741824" returned: 0 in 0.535s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 Sep 28 15:22:37 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6" returned: 0 in 0.300s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112baf38-61ba-475f-aac3-3214622b32d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d52566-b542-4355-976a-ed6c101d75b6', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f2237f-470c-4729-a189-6a25a5300696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Volume volume-38d52566-b542-4355-976a-ed6c101d75b6 (38d52566-b542-4355-976a-ed6c101d75b6): created successfully Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f2237f-470c-4729-a189-6a25a5300696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (edb9a291-9833-45b7-b4e2-4213dfa8598c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-180ad0d0-0842-4a8a-9d7e-7399b2968563 tempest-ProjectReaderTests-640229510 None] Created volume successfully. Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (9efe6026-3623-4806-9523-0f8c9c5cc3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20d3b6a-9054-46f8-b457-2e937cbd0001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20d3b6a-9054-46f8-b457-2e937cbd0001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016993053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b207a1d4-d17b-4663-81d0-ac521787eccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:38Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21a2689-06d7-42ed-b47e-423790c7c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21a2689-06d7-42ed-b47e-423790c7c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4dfd056-fd53-4bc0-8a07-e4f52a084748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4dfd056-fd53-4bc0-8a07-e4f52a084748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b207a1d4-d17b-4663-81d0-ac521787eccf', 'volume_name': 'volume-b207a1d4-d17b-4663-81d0-ac521787eccf', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19b60d3-ae12-44cb-af6c-bd94431acbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19b60d3-ae12-44cb-af6c-bd94431acbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ecb1a6-f5ba-412f-8dd4-00225f0320fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Volume b207a1d4-d17b-4663-81d0-ac521787eccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b207a1d4-d17b-4663-81d0-ac521787eccf', 'volume_size': 1} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016993053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b207a1d4-d17b-4663-81d0-ac521787eccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:38Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Creating volume b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:38 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf 1073741824 Sep 28 15:22:38 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Flow 'volume_create_manager' (c4e01db7-48cf-46b6-9234-e57d6a6eb013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7324bf-cd65-445f-8a6a-87c9d394efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7324bf-cd65-445f-8a6a-87c9d394efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-210267473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e0fd4b-0794-45c5-818c-091c5d4f3fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0634ea6e10e4cf7a87e79573bfcdda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f75bfbfb-b218-479b-a270-d9365fb7c221,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='f55f4405314f456bb4195e397d0e2a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6fd058-61b3-4ff4-b715-bde7ef6f999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6fd058-61b3-4ff4-b715-bde7ef6f999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a47fa9-338c-4ae3-bf58-1fecd46d6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a47fa9-338c-4ae3-bf58-1fecd46d6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7e0fd4b-0794-45c5-818c-091c5d4f3fac', 'volume_name': 'volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac', 'volume_size': 1, 'snapshot_id': 'f75bfbfb-b218-479b-a270-d9365fb7c221'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b29639e-a706-41b7-8034-7234be2c7193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b29639e-a706-41b7-8034-7234be2c7193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe5cd15-10a4-4cb6-842b-addc6e00877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Volume f7e0fd4b-0794-45c5-818c-091c5d4f3fac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac', 'volume_size': 1, 'snapshot_id': 'f75bfbfb-b218-479b-a270-d9365fb7c221'} Sep 28 15:22:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf 1073741824" returned: 0 in 0.439s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf Sep 28 15:22:39 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.605s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-quobyte-f75bfbfb-b218-479b-a270-d9365fb7c221-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ecb1a6-f5ba-412f-8dd4-00225f0320fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b207a1d4-d17b-4663-81d0-ac521787eccf', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce05f06b-b405-4160-a057-2b4b7c25c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f75bfbfb-b218-479b-a270-d9365fb7c221-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Creating volume f7e0fd4b-0794-45c5-818c-091c5d4f3fac from snapshot f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-quobyte-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:39 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Volume volume-b207a1d4-d17b-4663-81d0-ac521787eccf (b207a1d4-d17b-4663-81d0-ac521787eccf): created successfully Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce05f06b-b405-4160-a057-2b4b7c25c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (9efe6026-3623-4806-9523-0f8c9c5cc3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] snapshot: f75bfbfb-b218-479b-a270-d9365fb7c221, volume: f7e0fd4b-0794-45c5-818c-091c5d4f3fac, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:22:39 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a65f2626-c46e-440a-9211-660922128d2e tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c9ed1d-b005-4a90-8440-62959ae52871]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-38d52566-b542-4355-976a-ed6c101d75b6-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Lock "cinder-38d52566-b542-4355-976a-ed6c101d75b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-quobyte-38d52566-b542-4355-976a-ed6c101d75b6" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:39 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 Sep 28 15:22:39 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-38d52566-b542-4355-976a-ed6c101d75b6" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be8cc1-3f52-42e8-bba8-99ae40b49a81]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 Sep 28 15:22:39 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221" returned: 0 in 0.409s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3ef308-f358-40f6-9af4-e5bad8d33705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f5df4-a017-4dfe-9711-cf58dee828b4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 Sep 28 15:22:40 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6 Sep 28 15:22:40 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-38d52566-b542-4355-976a-ed6c101d75b6" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-38d52566-b542-4355-976a-ed6c101d75b6" released by "delete_volume" :: held 0.751s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Created reservations ['c92b2f23-cc48-4d2c-8d4a-dae2ea88ea09', '6b0de3de-27ba-4751-9f77-526dae5ca905', 'b756724f-113b-4292-baab-b42e37db2306', '0e50f07b-c4ac-4753-97c8-1076860a8bbf'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:40 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.318s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Deleted volume successfully. Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4c30a46b-4da3-484f-9157-055ccfe8d563 tempest-ProjectReaderTests-640229510 None] Lock "cinder-38d52566-b542-4355-976a-ed6c101d75b6-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (f78e32ba-dbff-4a3a-a13a-135e858fbd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a5ac1b-925c-4c11-ad51-b9206cf8cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a5ac1b-925c-4c11-ad51-b9206cf8cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351679013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be25f41-4c40-4a3d-a650-5be8d9263ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:42Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6aae6f-686d-42be-9868-fe8a27d14ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6aae6f-686d-42be-9868-fe8a27d14ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc97700-20b9-4d61-9112-68bfc227591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc97700-20b9-4d61-9112-68bfc227591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be25f41-4c40-4a3d-a650-5be8d9263ba1', 'volume_name': 'volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7032eee3-78c9-4736-989c-0fe358282f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7032eee3-78c9-4736-989c-0fe358282f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8e281e-9842-4ee0-9522-54908f3730c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Volume 3be25f41-4c40-4a3d-a650-5be8d9263ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1', 'volume_size': 1} Sep 28 15:22:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:46 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" returned: 0 in 6.200s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:22:46 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Converted 1024.00 MB image at 165.13 MB/s Sep 28 15:22:46 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac is being set with open permissions: ugo+rw Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac Sep 28 15:22:46 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" returned: 0 in 0.252s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" released by "_copy_volume_from_snapshot" :: held 7.389s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f75bfbfb-b218-479b-a270-d9365fb7c221-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" released by "_create_volume_from_snapshot" :: held 7.476s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.524s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.963s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot aba8176d-3566-4c47-ba9c-109c03832509 of volume b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe5cd15-10a4-4cb6-842b-addc6e00877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac', 'volume_size': 1, 'snapshot_id': 'f75bfbfb-b218-479b-a270-d9365fb7c221'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810a77f4-5974-4aad-8db8-72e0b9b6d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[61995ae8-4357-4f03-abde-f857b3b7117a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Volume volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac (f7e0fd4b-0794-45c5-818c-091c5d4f3fac): created successfully Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810a77f4-5974-4aad-8db8-72e0b9b6d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Flow 'volume_create_manager' (c4e01db7-48cf-46b6-9234-e57d6a6eb013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cadc0ce1-066b-4a29-92ee-9e4e09a6550d tempest-VolumeDependencyTests-793285182 None] Created volume successfully. Sep 28 15:22:47 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf Sep 28 15:22:47 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-f75bfbfb-b218-479b-a270-d9365fb7c221-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-f75bfbfb-b218-479b-a270-d9365fb7c221-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-quobyte-ee3ef308-f358-40f6-9af4-e5bad8d33705" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-ee3ef308-f358-40f6-9af4-e5bad8d33705" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-quobyte-f75bfbfb-b218-479b-a270-d9365fb7c221" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f75bfbfb-b218-479b-a270-d9365fb7c221" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Deleting offline snapshot f75bfbfb-b218-479b-a270-d9365fb7c221 of volume ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] snapshot_file for this snap is: volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4308fbd9-83df-422b-8e25-911360fd5401]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf" returned: 0 in 0.411s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 1G Sep 28 15:22:47 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 Sep 28 15:22:47 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221" returned: 0 in 0.391s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3ef308-f358-40f6-9af4-e5bad8d33705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2319961b-e9c3-4cab-be04-1efeb9405547]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 Sep 28 15:22:47 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 1G" returned: 0 in 0.498s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b207a1d4-d17b-4663-81d0-ac521787eccf -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b207a1d4-d17b-4663-81d0-ac521787eccf -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 Sep 28 15:22:47 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b207a1d4-d17b-4663-81d0-ac521787eccf -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509" returned: 0 in 0.314s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 is being set with open permissions: ugo+rw Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 Sep 28 15:22:48 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705" returned: 0 in 0.615s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 Sep 28 15:22:48 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509" returned: 0 in 0.289s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info Sep 28 15:22:48 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221" returned: 0 in 0.437s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221 Sep 28 15:22:48 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info" returned: 0 in 0.331s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info is being set with open permissions: ugo+rw Sep 28 15:22:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info Sep 28 15:22:48 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705.f75bfbfb-b218-479b-a270-d9365fb7c221" returned: 0 in 0.249s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f75bfbfb-b218-479b-a270-d9365fb7c221" released by "_delete_snapshot" :: held 1.802s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-ee3ef308-f358-40f6-9af4-e5bad8d33705" released by "delete_snapshot" :: held 1.823s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.info" returned: 0 in 0.292s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.361s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351679013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be25f41-4c40-4a3d-a650-5be8d9263ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:42Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Creating volume 3be25f41-4c40-4a3d-a650-5be8d9263ba1 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:49 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Created reservations ['3c36729d-89dc-44d5-ab3b-7bdabae74c18', '058b16ac-c92c-419e-9505-4928d5b88e1a', '244094e1-cfaf-44e1-93ab-ee57bf8a276b', 'eabf7539-a4f5-4f9f-913e-10c0d87ccfd7'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:49 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 1073741824 Sep 28 15:22:49 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-82ab88a6-975b-47d2-91e5-47c2dafd1253 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:22:49 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Delete snapshot completed successfully. Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-5cc67029-9e47-4048-a43d-3d0e976956c1 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-f75bfbfb-b218-479b-a270-d9365fb7c221-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-ee3ef308-f358-40f6-9af4-e5bad8d33705-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-ee3ef308-f358-40f6-9af4-e5bad8d33705-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-aba8176d-3566-4c47-ba9c-109c03832509-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-aba8176d-3566-4c47-ba9c-109c03832509-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-b207a1d4-d17b-4663-81d0-ac521787eccf" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-b207a1d4-d17b-4663-81d0-ac521787eccf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-aba8176d-3566-4c47-ba9c-109c03832509" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-quobyte-ee3ef308-f358-40f6-9af4-e5bad8d33705" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-aba8176d-3566-4c47-ba9c-109c03832509" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot aba8176d-3566-4c47-ba9c-109c03832509 of volume b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-ee3ef308-f358-40f6-9af4-e5bad8d33705" acquired by "delete_volume" :: waited 0.048s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11d06ce-1c87-44f6-8649-894bc791e29c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a80743b-f095-4c21-9f9b-2e8ca1c37b65]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 Sep 28 15:22:49 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 Sep 28 15:22:49 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 1073741824" returned: 0 in 0.525s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 Sep 28 15:22:49 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509" returned: 0 in 0.405s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b207a1d4-d17b-4663-81d0-ac521787eccf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:49 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705" returned: 0 in 0.426s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc3bc9f-1b34-4b8f-b8ae-0b05f4ccb9a8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1" returned: 0 in 0.300s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705 Sep 28 15:22:50 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8e281e-9842-4ee0-9522-54908f3730c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbc4f91-f20d-4d1c-9750-c96f9bd5cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:50 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Volume volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 (3be25f41-4c40-4a3d-a650-5be8d9263ba1): created successfully Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbc4f91-f20d-4d1c-9750-c96f9bd5cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (f78e32ba-dbff-4a3a-a13a-135e858fbd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-38bb49d5-2567-4a81-bbdc-789ea43cc1de tempest-ProjectReaderTests-640229510 None] Created volume successfully. Sep 28 15:22:50 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf Sep 28 15:22:50 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ee3ef308-f358-40f6-9af4-e5bad8d33705" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-ee3ef308-f358-40f6-9af4-e5bad8d33705" released by "delete_volume" :: held 0.762s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Created reservations ['57b357a7-78e0-4c88-a482-2f919160189d', '946e25a5-bd46-4453-9925-03c14931aba0', '692e781d-248a-4e7c-9c4c-b72f9c43268c', '8fb6fa71-0388-4038-b80c-03d8102c196d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:50 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf" returned: 0 in 0.424s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:50 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 Sep 28 15:22:50 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-f7e0fd4b-0794-45c5-818c-091c5d4f3fac-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Lock "cinder-f7e0fd4b-0794-45c5-818c-091c5d4f3fac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Acquiring lock "cinder-quobyte-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c663abc0-d653-4f53-80d9-1457bfd5f49d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.324s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Deleted volume successfully. Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba4a2e00-e2a7-475c-91dc-0f5df69309d0 tempest-VolumeDependencyTests-793285182 None] Lock "cinder-ee3ef308-f358-40f6-9af4-e5bad8d33705-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:50 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509" returned: 0 in 0.419s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac Sep 28 15:22:50 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509 Sep 28 15:22:50 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf.aba8176d-3566-4c47-ba9c-109c03832509" returned: 0 in 0.273s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-aba8176d-3566-4c47-ba9c-109c03832509" released by "_delete_snapshot" :: held 1.701s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-b207a1d4-d17b-4663-81d0-ac521787eccf" released by "delete_snapshot" :: held 1.727s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" returned: 0 in 0.472s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac Sep 28 15:22:51 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-3be25f41-4c40-4a3d-a650-5be8d9263ba1-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Lock "cinder-3be25f41-4c40-4a3d-a650-5be8d9263ba1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Created reservations ['ac9a68ab-e83b-4464-84f4-a3b527fc6d99', 'fe443cb7-ba86-48ce-84d0-791051d49119', '42d76e87-d7e3-45d1-9037-4cf769d31a9c', '36bce8fc-8335-4755-8d05-681de02cf210'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-quobyte-3be25f41-4c40-4a3d-a650-5be8d9263ba1" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-3be25f41-4c40-4a3d-a650-5be8d9263ba1" acquired by "delete_volume" :: waited 0.034s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[462cd7fb-f06d-4701-a2ca-83bd4ab8f95f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-7bd7e538-b8f8-46d8-9732-989b0ef32866 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-aba8176d-3566-4c47-ba9c-109c03832509-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 Sep 28 15:22:51 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" returned: 0 in 0.345s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Lock "cinder-quobyte-f7e0fd4b-0794-45c5-818c-091c5d4f3fac" released by "delete_volume" :: held 0.866s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-b207a1d4-d17b-4663-81d0-ac521787eccf-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Created reservations ['06e8ecca-e5d2-4d03-967b-cef06c133574', '67f2d0aa-380b-4bbf-8b7b-556a4217ee2f', '0567286a-00f5-4060-9e73-68327af588e9', 'f4de83e1-7513-40d5-9f4c-d43f1b0fa606'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-b207a1d4-d17b-4663-81d0-ac521787eccf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-b207a1d4-d17b-4663-81d0-ac521787eccf" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-b207a1d4-d17b-4663-81d0-ac521787eccf" acquired by "delete_volume" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196f206-764f-42e8-a474-7cd3947b7cc3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:51 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1" returned: 0 in 0.552s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1 Sep 28 15:22:51 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf Sep 28 15:22:52 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.312s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Deleted volume successfully. Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f831b658-9722-4d94-b7ff-2e296f7ebc0e tempest-VolumeDependencyTests-793285182 None] Lock "cinder-f7e0fd4b-0794-45c5-818c-091c5d4f3fac-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-3be25f41-4c40-4a3d-a650-5be8d9263ba1" returned: 0 in 0.317s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-3be25f41-4c40-4a3d-a650-5be8d9263ba1" released by "delete_volume" :: held 0.929s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf" returned: 0 in 0.462s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Created reservations ['788b4f92-5876-4161-83d3-85d554e76da8', '286aa3d9-92f7-4ceb-bcbb-a56f255b9e74', '7fcbe049-5418-4d4a-9d0e-76d1d49146df', '3a9e45af-b7e0-47fa-9716-28f47290748a'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:52 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf Sep 28 15:22:52 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:52 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-b207a1d4-d17b-4663-81d0-ac521787eccf" returned: 0 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-b207a1d4-d17b-4663-81d0-ac521787eccf" released by "delete_volume" :: held 0.979s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.304s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Deleted volume successfully. Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-481f60bc-54af-47da-9a43-0c1582ca0b6a tempest-ProjectReaderTests-640229510 None] Lock "cinder-3be25f41-4c40-4a3d-a650-5be8d9263ba1-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Created reservations ['44ad5539-1452-4e84-82ce-653f0132cfe3', '421952f7-cd6b-4bf4-910b-08b8d08e71c6', 'ac3a53b4-e027-4612-8467-e2c978c90b8c', '251657d6-e6a4-4340-a6e5-f8f62e7c4071'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:52 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:53 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:22:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-cce272d5-41cd-4009-8173-bbed9bc74dd0 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-b207a1d4-d17b-4663-81d0-ac521787eccf-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (9e3edbbd-0450-4d7e-94be-dbcd967a0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1d4e47-26c9-447a-95cd-5c28f984dcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1d4e47-26c9-447a-95cd-5c28f984dcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976221620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95dc932-5b8c-4c0b-8d39-681cec060ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:54Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2a5737-697f-41a6-8247-8493db5f4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2a5737-697f-41a6-8247-8493db5f4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4758ab10-cbda-46a5-a463-d2f5da501b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4758ab10-cbda-46a5-a463-d2f5da501b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95dc932-5b8c-4c0b-8d39-681cec060ae4', 'volume_name': 'volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab03dc58-6b97-475f-8a95-b87a19ea29b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab03dc58-6b97-475f-8a95-b87a19ea29b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb01a8e-0b20-4095-8cc9-04b55a5ff5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Volume a95dc932-5b8c-4c0b-8d39-681cec060ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4', 'volume_size': 1} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976221620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95dc932-5b8c-4c0b-8d39-681cec060ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:54Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Creating volume a95dc932-5b8c-4c0b-8d39-681cec060ae4 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:54 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 1073741824 Sep 28 15:22:54 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (8a587ad5-4498-4cce-b963-90e59149eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ab6f44-90ea-452b-a650-3493e73c21e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ab6f44-90ea-452b-a650-3493e73c21e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347190381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177125ef-c052-412f-b1d8-6aef5e740bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:54Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0bd9ff-1c8a-4d59-bc13-b9e23eb87368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0bd9ff-1c8a-4d59-bc13-b9e23eb87368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b347213-45a8-4d2a-a4b8-e125053c7fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b347213-45a8-4d2a-a4b8-e125053c7fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177125ef-c052-412f-b1d8-6aef5e740bb8', 'volume_name': 'volume-177125ef-c052-412f-b1d8-6aef5e740bb8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2235aea-c3ad-41a3-a32c-243a97ae51cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2235aea-c3ad-41a3-a32c-243a97ae51cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f138ba-8031-49bb-bf68-5ec09027b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Volume 177125ef-c052-412f-b1d8-6aef5e740bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177125ef-c052-412f-b1d8-6aef5e740bb8', 'volume_size': 1} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:54 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 1073741824" returned: 0 in 0.565s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 Sep 28 15:22:54 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347190381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177125ef-c052-412f-b1d8-6aef5e740bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:54Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Creating volume 177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:55 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb01a8e-0b20-4095-8cc9-04b55a5ff5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 1073741824 Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91f4b7-a395-4354-9b9a-ca7f7ebb627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Volume volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 (a95dc932-5b8c-4c0b-8d39-681cec060ae4): created successfully Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91f4b7-a395-4354-9b9a-ca7f7ebb627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (9e3edbbd-0450-4d7e-94be-dbcd967a0bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d3b13054-aa91-4d12-b9d1-8e96c3c634a2 tempest-ProjectReaderTests-640229510 None] Created volume successfully. Sep 28 15:22:55 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 1073741824" returned: 0 in 0.489s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 Sep 28 15:22:55 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8" returned: 0 in 0.260s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f138ba-8031-49bb-bf68-5ec09027b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177125ef-c052-412f-b1d8-6aef5e740bb8', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac5c7bd-1c74-4ccc-b5a2-8abc427c7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Volume volume-177125ef-c052-412f-b1d8-6aef5e740bb8 (177125ef-c052-412f-b1d8-6aef5e740bb8): created successfully Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac5c7bd-1c74-4ccc-b5a2-8abc427c7519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (8a587ad5-4498-4cce-b963-90e59149eecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5e09305e-f5a1-451d-aa9c-d4ac2b372516 tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-a95dc932-5b8c-4c0b-8d39-681cec060ae4-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Lock "cinder-a95dc932-5b8c-4c0b-8d39-681cec060ae4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-quobyte-a95dc932-5b8c-4c0b-8d39-681cec060ae4" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-a95dc932-5b8c-4c0b-8d39-681cec060ae4" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[380266ad-8507-40f1-a933-6477b18fe142]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 Sep 28 15:22:56 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4" returned: 0 in 0.432s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:56 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4 Sep 28 15:22:56 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot 532dc776-b34f-43c4-b691-56cde94e97a2 of volume 177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1d1b3-5456-45bd-8f5a-2434335edd6d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 Sep 28 15:22:56 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a95dc932-5b8c-4c0b-8d39-681cec060ae4" returned: 0 in 0.282s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-a95dc932-5b8c-4c0b-8d39-681cec060ae4" released by "delete_volume" :: held 0.762s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Created reservations ['3d36b0cf-814b-4455-a826-c54dbd77a21f', '46ccf473-a667-4013-90ef-bf0ec51186cd', '912ca2ca-24e4-4cc3-8c58-771ed025962e', '7bf55b65-63a3-40e2-9a74-26f66a7242d8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:22:57 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8" returned: 0 in 0.450s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 1G Sep 28 15:22:57 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.319s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Deleted volume successfully. Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-487345c3-43a1-44f4-86f0-2614d822b35c tempest-ProjectReaderTests-640229510 None] Lock "cinder-a95dc932-5b8c-4c0b-8d39-681cec060ae4-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:57 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 1G" returned: 0 in 0.567s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-177125ef-c052-412f-b1d8-6aef5e740bb8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-177125ef-c052-412f-b1d8-6aef5e740bb8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 Sep 28 15:22:57 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (2ac0499a-e5c5-440d-8031-3633e2f3cf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b15beab-6297-4847-8925-e573f65ec2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b15beab-6297-4847-8925-e573f65ec2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-954241738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a84d61-a85e-4120-9730-cfdb8292fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:58Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314a0ed8-7c71-4ed4-bf35-fbf93e24399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314a0ed8-7c71-4ed4-bf35-fbf93e24399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bce1a7-f32f-42a1-9bd8-c08bc9bf4d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bce1a7-f32f-42a1-9bd8-c08bc9bf4d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a84d61-a85e-4120-9730-cfdb8292fc6b', 'volume_name': 'volume-42a84d61-a85e-4120-9730-cfdb8292fc6b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f79b6f-0e59-4a10-ac1c-4d323b6e2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f79b6f-0e59-4a10-ac1c-4d323b6e2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1869a4-5902-4314-a4b2-a0d3f2d2b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Volume 42a84d61-a85e-4120-9730-cfdb8292fc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a84d61-a85e-4120-9730-cfdb8292fc6b', 'volume_size': 1} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:58 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-177125ef-c052-412f-b1d8-6aef5e740bb8 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 is being set with open permissions: ugo+rw Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 Sep 28 15:22:58 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2" returned: 0 in 0.280s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info Sep 28 15:22:58 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info" returned: 0 in 0.312s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info is being set with open permissions: ugo+rw Sep 28 15:22:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info Sep 28 15:22:58 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.info" returned: 0 in 0.269s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-954241738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a84d61-a85e-4120-9730-cfdb8292fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f125fa800a24bbc9b5465404bbcd442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:58Z,use_quota=True,user_id='f6384a657bd14990bc56f5c8c6c0ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Creating volume 42a84d61-a85e-4120-9730-cfdb8292fc6b {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:59 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b 1073741824 Sep 28 15:22:59 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-77793855-d803-4616-992e-968a1cd29a36 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:22:59 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b 1073741824" returned: 0 in 0.479s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b Sep 28 15:22:59 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b" returned: 0 in 0.291s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1869a4-5902-4314-a4b2-a0d3f2d2b625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a84d61-a85e-4120-9730-cfdb8292fc6b', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998845eb-c799-45f0-983d-e1b6154bccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:59 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Volume volume-42a84d61-a85e-4120-9730-cfdb8292fc6b (42a84d61-a85e-4120-9730-cfdb8292fc6b): created successfully Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998845eb-c799-45f0-983d-e1b6154bccd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:59 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Flow 'volume_create_manager' (2ac0499a-e5c5-440d-8031-3633e2f3cf4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-532dc776-b34f-43c4-b691-56cde94e97a2-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-703438a6-00cc-49d1-b612-3d000d9ec9a6 tempest-ProjectReaderTests-640229510 None] Created volume successfully. Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-532dc776-b34f-43c4-b691-56cde94e97a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-177125ef-c052-412f-b1d8-6aef5e740bb8" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-177125ef-c052-412f-b1d8-6aef5e740bb8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-532dc776-b34f-43c4-b691-56cde94e97a2" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-532dc776-b34f-43c4-b691-56cde94e97a2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot 532dc776-b34f-43c4-b691-56cde94e97a2 of volume 177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c1af09-229f-435b-b680-acef1fa47a61]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 Sep 28 15:23:00 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2" returned: 0 in 0.407s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-177125ef-c052-412f-b1d8-6aef5e740bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f9b8ef-76b5-4b1f-a45c-7d88a841403b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 Sep 28 15:23:00 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8" returned: 0 in 0.373s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 Sep 28 15:23:00 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-42a84d61-a85e-4120-9730-cfdb8292fc6b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Lock "cinder-42a84d61-a85e-4120-9730-cfdb8292fc6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (6129fbee-7881-4f0e-b113-3cde5827d501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1452aa0-9cad-4b42-b661-10f6b84396cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1452aa0-9cad-4b42-b661-10f6b84396cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-763354942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52368f8-8501-4842-8a4b-e12f63e93eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:01Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04340933-db04-4019-a221-3ed2e99bd3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04340933-db04-4019-a221-3ed2e99bd3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1681ab-7cd4-4a74-ad9e-a17dd78bf3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1681ab-7cd4-4a74-ad9e-a17dd78bf3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52368f8-8501-4842-8a4b-e12f63e93eb1', 'volume_name': 'volume-c52368f8-8501-4842-8a4b-e12f63e93eb1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c773f218-c60c-494e-b9fa-9545d4525655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c773f218-c60c-494e-b9fa-9545d4525655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac51862e-ed56-46c6-8b87-60ba96a9129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Volume c52368f8-8501-4842-8a4b-e12f63e93eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52368f8-8501-4842-8a4b-e12f63e93eb1', 'volume_size': 1} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-763354942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52368f8-8501-4842-8a4b-e12f63e93eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:01Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Creating volume c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:01 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2" returned: 0 in 0.476s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 1073741824 Sep 28 15:23:01 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2 Sep 28 15:23:01 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Acquiring lock "cinder-quobyte-42a84d61-a85e-4120-9730-cfdb8292fc6b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-42a84d61-a85e-4120-9730-cfdb8292fc6b" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de1ff4-9d32-4500-9263-c98ab54ef01d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b Sep 28 15:23:01 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8.532dc776-b34f-43c4-b691-56cde94e97a2" returned: 0 in 0.287s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-532dc776-b34f-43c4-b691-56cde94e97a2" released by "_delete_snapshot" :: held 1.687s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-177125ef-c052-412f-b1d8-6aef5e740bb8" released by "delete_snapshot" :: held 1.720s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Created reservations ['aba63e3b-e0b7-4f9c-8bfe-b60c191568f1', '6a884a2a-761d-4fd6-8a31-ad4e7d74e48a', '98382668-2b34-42c1-88d1-baa9a1749460', '873f72c4-0d8f-439c-819c-b8577a6384c4'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-b749aa82-f566-4258-9996-c75b685300a7 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-532dc776-b34f-43c4-b691-56cde94e97a2-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:01 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 1073741824" returned: 0 in 0.555s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b" returned: 0 in 0.454s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b Sep 28 15:23:02 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 Sep 28 15:23:02 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-42a84d61-a85e-4120-9730-cfdb8292fc6b" returned: 0 in 0.282s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Lock "cinder-quobyte-42a84d61-a85e-4120-9730-cfdb8292fc6b" released by "delete_volume" :: held 0.802s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:02 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1" returned: 0 in 0.302s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-177125ef-c052-412f-b1d8-6aef5e740bb8-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac51862e-ed56-46c6-8b87-60ba96a9129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52368f8-8501-4842-8a4b-e12f63e93eb1', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5311952-01f8-475b-9157-a6aa756504a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-177125ef-c052-412f-b1d8-6aef5e740bb8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Volume volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 (c52368f8-8501-4842-8a4b-e12f63e93eb1): created successfully Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5311952-01f8-475b-9157-a6aa756504a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (6129fbee-7881-4f0e-b113-3cde5827d501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Created reservations ['95f15013-e614-4ced-a162-5aaabad38ab8', 'a54d5f01-bc06-4e14-8366-2249a39d9172', 'd063cb1b-925d-4747-a766-017e42af0e87', 'd54c7491-c9ac-4392-a799-dacfa53d7eb9'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-951181b4-589f-43e6-baa2-4bc3bb34b143 tempest-ProjectReaderTests-179599538 None] Created volume successfully. Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-177125ef-c052-412f-b1d8-6aef5e740bb8" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-177125ef-c052-412f-b1d8-6aef5e740bb8" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8a266-ea79-4481-b028-d644db590ea6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:02 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 Sep 28 15:23:02 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Deleted volume successfully. Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a61de4dc-7c65-4d4a-bb1b-51abb783a4ae tempest-ProjectReaderTests-640229510 None] Lock "cinder-42a84d61-a85e-4120-9730-cfdb8292fc6b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:02 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8" returned: 0 in 0.402s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8 Sep 28 15:23:02 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-177125ef-c052-412f-b1d8-6aef5e740bb8" returned: 0 in 0.253s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-177125ef-c052-412f-b1d8-6aef5e740bb8" released by "delete_volume" :: held 0.721s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Created reservations ['dc6388ec-7d8b-4e98-9071-7dc0e897edf4', '1910abea-bedc-4715-824c-efedb1b15d00', 'a001d481-c45f-4ea3-accb-b8c349a7dd1f', 'a8865acd-eaa7-483f-8a35-71a3ac195a9b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:03 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.360s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:03 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Creating offline snapshot 1bc389d2-3772-4c8e-9457-08511d5ee142 of volume c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-08eabd39-b211-4603-af08-71dd0b8a4242 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-177125ef-c052-412f-b1d8-6aef5e740bb8-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8709ff-f3b8-4946-9573-3c0c80ef5eb9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 Sep 28 15:23:03 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:04 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (d92dd112-dd5e-44a7-8839-d7b4d6e9e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616a9dcb-0fad-4223-b758-95c36354bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1" returned: 0 in 0.433s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616a9dcb-0fad-4223-b758-95c36354bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861484946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:04Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:04 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 1G Sep 28 15:23:04 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7ac19c-b814-4501-9e2b-dfd4db1fa41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7ac19c-b814-4501-9e2b-dfd4db1fa41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf6af80-878a-44cf-afbb-15c2f7e5a3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf6af80-878a-44cf-afbb-15c2f7e5a3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e', 'volume_name': 'volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facaec37-4ddc-4389-b230-5bfcb0b49e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facaec37-4ddc-4389-b230-5bfcb0b49e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a61925b-9e1c-46a7-a747-d39643e7aeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:04 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Volume 04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e', 'volume_size': 1} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:04 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 1G" returned: 0 in 0.491s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 Sep 28 15:23:04 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142" returned: 0 in 0.385s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 is being set with open permissions: ugo+rw Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 Sep 28 15:23:05 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142" returned: 0 in 0.272s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info Sep 28 15:23:05 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info" returned: 0 in 0.284s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info is being set with open permissions: ugo+rw Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info Sep 28 15:23:05 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.info" returned: 0 in 0.253s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861484946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:04Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Creating volume 04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:05 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e 1073741824 Sep 28 15:23:06 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-75f5ff27-ef60-418f-8e5a-94a29a756c4a tempest-ProjectReaderTests-179599538 None] Create snapshot completed successfully Sep 28 15:23:06 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e 1073741824" returned: 0 in 0.424s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e Sep 28 15:23:06 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" returned: 0 in 0.245s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a61925b-9e1c-46a7-a747-d39643e7aeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923704f3-208c-4475-88c7-56b11d6a67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:06 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Volume volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e (04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e): created successfully Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923704f3-208c-4475-88c7-56b11d6a67c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:06 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (d92dd112-dd5e-44a7-8839-d7b4d6e9e2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:06 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-b3d7fbf3-ad12-4804-ab13-1912ec642610 tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-1bc389d2-3772-4c8e-9457-08511d5ee142-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Lock "cinder-1bc389d2-3772-4c8e-9457-08511d5ee142-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-c52368f8-8501-4842-8a4b-e12f63e93eb1" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-c52368f8-8501-4842-8a4b-e12f63e93eb1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-1bc389d2-3772-4c8e-9457-08511d5ee142" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-1bc389d2-3772-4c8e-9457-08511d5ee142" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Deleting offline snapshot 1bc389d2-3772-4c8e-9457-08511d5ee142 of volume c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] snapshot_file for this snap is: volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45b7240-89fa-4865-834c-5280afc692ed]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 Sep 28 15:23:07 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot e7c0c9b4-202d-424f-844b-322fb085e873 of volume 04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[86810f4b-965c-4617-a140-d3c5ae0b3da6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142" returned: 0 in 0.435s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c52368f8-8501-4842-8a4b-e12f63e93eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a2202e-19a2-4c1a-86d5-243f737fae9d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e Sep 28 15:23:07 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 Sep 28 15:23:07 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" returned: 0 in 0.411s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 1G Sep 28 15:23:08 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1" returned: 0 in 0.406s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 Sep 28 15:23:08 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 1G" returned: 0 in 0.447s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142" returned: 0 in 0.370s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 Sep 28 15:23:08 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142 Sep 28 15:23:08 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1.1bc389d2-3772-4c8e-9457-08511d5ee142" returned: 0 in 0.277s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873" returned: 0 in 0.321s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 is being set with open permissions: ugo+rw Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-1bc389d2-3772-4c8e-9457-08511d5ee142" released by "_delete_snapshot" :: held 1.625s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-c52368f8-8501-4842-8a4b-e12f63e93eb1" released by "delete_snapshot" :: held 1.650s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:08 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 Sep 28 15:23:08 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Created reservations ['0e5a0701-343a-4650-acf8-91d532c1e76b', '31cd3d6c-666d-432f-af11-0ce585253e4e', 'e0b4c589-1d06-4577-b2e1-bbc6e6497f52', '852217f0-344a-41d3-893b-4fd5adcc33cd'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:08 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Delete snapshot completed successfully. Sep 28 15:23:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-09f45810-2863-46c0-813b-76367c11536c tempest-ProjectReaderTests-179599538 None] Lock "cinder-1bc389d2-3772-4c8e-9457-08511d5ee142-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:09 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873" returned: 0 in 0.283s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info Sep 28 15:23:09 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-c52368f8-8501-4842-8a4b-e12f63e93eb1-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Lock "cinder-c52368f8-8501-4842-8a4b-e12f63e93eb1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-c52368f8-8501-4842-8a4b-e12f63e93eb1" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:09 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info" returned: 0 in 0.288s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info is being set with open permissions: ugo+rw Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-c52368f8-8501-4842-8a4b-e12f63e93eb1" acquired by "delete_volume" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:09 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info Sep 28 15:23:09 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddda213-4f4c-4ea0-80a2-352f2377eb38]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 Sep 28 15:23:09 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.info" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:09 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-95a90f57-92e7-4492-8828-0b09ee434c09 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:23:09 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1" returned: 0 in 0.421s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1 Sep 28 15:23:09 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-c52368f8-8501-4842-8a4b-e12f63e93eb1" returned: 0 in 0.261s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-c52368f8-8501-4842-8a4b-e12f63e93eb1" released by "delete_volume" :: held 0.759s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Created reservations ['2160d0c9-03db-4e28-a880-7815cb47c700', '56f4d6ec-38e5-4f7b-991c-1b88408736f9', '05eef31f-e12f-4c18-8cc7-08da3adc1d05', '573c1fab-c294-4561-9ab2-bf9467340c61'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:10 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.293s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:10 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Deleted volume successfully. Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-aa102603-42c2-4082-a059-6f42349d76a1 tempest-ProjectReaderTests-179599538 None] Lock "cinder-c52368f8-8501-4842-8a4b-e12f63e93eb1-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-e7c0c9b4-202d-424f-844b-322fb085e873-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-e7c0c9b4-202d-424f-844b-322fb085e873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-e7c0c9b4-202d-424f-844b-322fb085e873" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-e7c0c9b4-202d-424f-844b-322fb085e873" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot e7c0c9b4-202d-424f-844b-322fb085e873 of volume 04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e1c52f-675b-424c-b2af-251be2f3c444]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:10 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 Sep 28 15:23:10 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (6b0f95db-5bfa-41ef-87e2-ecaee350e6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301ae7c-dbd0-476f-bafb-efde10636efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301ae7c-dbd0-476f-bafb-efde10636efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965915442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49056b7-5136-42f4-87a1-bec834306007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:11Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bbbefb-476c-4f1e-bf62-67780a933efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bbbefb-476c-4f1e-bf62-67780a933efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f2808e-eaa5-4d0d-9c1c-c0e6f5f48ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f2808e-eaa5-4d0d-9c1c-c0e6f5f48ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49056b7-5136-42f4-87a1-bec834306007', 'volume_name': 'volume-f49056b7-5136-42f4-87a1-bec834306007', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd5c961-5016-4d76-ba34-935d6d53435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd5c961-5016-4d76-ba34-935d6d53435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45c9474-c395-45bb-91e7-b763d2057b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:11 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Volume f49056b7-5136-42f4-87a1-bec834306007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49056b7-5136-42f4-87a1-bec834306007', 'volume_size': 1} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965915442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49056b7-5136-42f4-87a1-bec834306007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:11Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Creating volume f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:11 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 1073741824 Sep 28 15:23:11 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873" returned: 0 in 0.450s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[05814786-b816-4c79-9326-c7f0a7b71bce]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e Sep 28 15:23:11 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 1073741824" returned: 0 in 0.472s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" returned: 0 in 0.411s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 Sep 28 15:23:11 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 Sep 28 15:23:11 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:12 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007" returned: 0 in 0.330s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45c9474-c395-45bb-91e7-b763d2057b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49056b7-5136-42f4-87a1-bec834306007', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b968df-9a4d-4033-bddc-5d257481f375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:12 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Volume volume-f49056b7-5136-42f4-87a1-bec834306007 (f49056b7-5136-42f4-87a1-bec834306007): created successfully Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b968df-9a4d-4033-bddc-5d257481f375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (6b0f95db-5bfa-41ef-87e2-ecaee350e6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-088a3781-5d33-4d69-9967-c4380bcc1d0f tempest-ProjectReaderTests-179599538 None] Created volume successfully. Sep 28 15:23:12 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873" returned: 0 in 0.399s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:12 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873 Sep 28 15:23:12 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:12 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e.e7c0c9b4-202d-424f-844b-322fb085e873" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-e7c0c9b4-202d-424f-844b-322fb085e873" released by "_delete_snapshot" :: held 1.636s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" released by "delete_snapshot" :: held 1.668s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Created reservations ['cb75504c-7889-4688-9156-8b14204e3128', '67f38069-9a1e-4566-8d55-0a3e9497a4fc', '2d015afe-713c-44b0-b172-406820076bc2', '021afdb7-8d68-41ea-a5e8-326a76c415c2'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:12 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-64bac297-4040-48b9-9fba-b6f92b77f104 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-e7c0c9b4-202d-424f-844b-322fb085e873-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:12 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d03e92-9617-49ed-8d0c-98371aabd153]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e Sep 28 15:23:13 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Creating offline snapshot dd10864f-8b2e-427e-9bf1-b799376d4fd6 of volume f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc42b7bf-523e-489f-97ba-c067da6f1764]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" returned: 0 in 0.441s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 Sep 28 15:23:13 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e Sep 28 15:23:13 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" returned: 0 in 0.293s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e" released by "delete_volume" :: held 0.828s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:13 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007" returned: 0 in 0.457s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 1G Sep 28 15:23:13 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Created reservations ['cf5448e2-bb7b-4938-9160-80c0c5769560', 'e1619d5f-2d08-49cd-9834-eeabb51445e2', '38866938-0d13-40c7-bae9-56ec454b54ac', '72d5805f-183e-41c6-9add-3ccb659b76ca'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:13 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:14 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:14 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.316s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:14 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-39eae09c-f40a-452e-9f44-df554b6cb465 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-04fd52d5-5fa6-44a7-b0db-ad2ec6e19a9e-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:14 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 1G" returned: 0 in 0.540s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49056b7-5136-42f4-87a1-bec834306007 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:14 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49056b7-5136-42f4-87a1-bec834306007 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 Sep 28 15:23:14 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49056b7-5136-42f4-87a1-bec834306007 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6" returned: 0 in 0.363s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 is being set with open permissions: ugo+rw Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:14 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 Sep 28 15:23:14 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (3342695b-6aee-4c19-8a63-b25ab386f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9834c5f9-b2a7-4541-a8a4-d95b09b757c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9834c5f9-b2a7-4541-a8a4-d95b09b757c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474295040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5c487f-8cd2-485c-92f5-44bcadc4ea48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:15Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b33075d-32eb-47a9-8eba-1b5a5e977cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b33075d-32eb-47a9-8eba-1b5a5e977cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (214d226a-308f-4af5-80d1-c3effe591e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (214d226a-308f-4af5-80d1-c3effe591e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5c487f-8cd2-485c-92f5-44bcadc4ea48', 'volume_name': 'volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16c2cc7-dd79-4498-b282-5fd0bf39709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16c2cc7-dd79-4498-b282-5fd0bf39709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d213c9-faf5-4b21-bc3a-94edfd92ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Volume 0b5c487f-8cd2-485c-92f5-44bcadc4ea48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48', 'volume_size': 1} Sep 28 15:23:14 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:15 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info Sep 28 15:23:15 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info" returned: 0 in 0.295s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info is being set with open permissions: ugo+rw Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info Sep 28 15:23:15 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.info" returned: 0 in 0.267s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474295040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5c487f-8cd2-485c-92f5-44bcadc4ea48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:15Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Creating volume 0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:15 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:15 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 1073741824 Sep 28 15:23:15 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-18b8d525-a407-45eb-931e-6aa58b82cf47 tempest-ProjectReaderTests-179599538 None] Create snapshot completed successfully Sep 28 15:23:16 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 1073741824" returned: 0 in 0.474s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 Sep 28 15:23:16 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:16 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" returned: 0 in 0.253s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d213c9-faf5-4b21-bc3a-94edfd92ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a967f6a9-35b9-4283-9a8e-679c7e2d0d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Volume volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 (0b5c487f-8cd2-485c-92f5-44bcadc4ea48): created successfully Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a967f6a9-35b9-4283-9a8e-679c7e2d0d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (3342695b-6aee-4c19-8a63-b25ab386f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:16 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-01518c88-5885-473a-b385-44a5b2b98504 tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-dd10864f-8b2e-427e-9bf1-b799376d4fd6-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Lock "cinder-dd10864f-8b2e-427e-9bf1-b799376d4fd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-f49056b7-5136-42f4-87a1-bec834306007" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-f49056b7-5136-42f4-87a1-bec834306007" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-dd10864f-8b2e-427e-9bf1-b799376d4fd6" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-dd10864f-8b2e-427e-9bf1-b799376d4fd6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Deleting offline snapshot dd10864f-8b2e-427e-9bf1-b799376d4fd6 of volume f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] snapshot_file for this snap is: volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e49307a-ea73-4955-ac29-5dd01c075f11]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:16 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 Sep 28 15:23:16 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot be5af542-40b4-4729-aef7-3dd79630f201 of volume 0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fdefeb-8635-4e0b-aeba-2713212b67c2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6" returned: 0 in 0.461s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49056b7-5136-42f4-87a1-bec834306007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c31664-9272-44c0-b1c7-8583f373543c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 Sep 28 15:23:17 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 Sep 28 15:23:17 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" returned: 0 in 0.451s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 1G Sep 28 15:23:17 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007" returned: 0 in 0.508s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 Sep 28 15:23:17 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 1G" returned: 0 in 0.474s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 Sep 28 15:23:18 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6" returned: 0 in 0.423s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6 Sep 28 15:23:18 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201" returned: 0 in 0.313s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 is being set with open permissions: ugo+rw Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 Sep 28 15:23:18 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007.dd10864f-8b2e-427e-9bf1-b799376d4fd6" returned: 0 in 0.361s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-dd10864f-8b2e-427e-9bf1-b799376d4fd6" released by "_delete_snapshot" :: held 1.868s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-f49056b7-5136-42f4-87a1-bec834306007" released by "delete_snapshot" :: held 1.899s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201" returned: 0 in 0.256s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Created reservations ['c39faaa7-52b8-40e9-bf81-0d6e23892ca3', 'a4bb4d73-a094-4eb5-9613-b95109e1ec78', 'aab2651b-2b75-48df-b631-01aeadf7e460', 'e8400d28-42cb-489e-afb8-a057e0cbf0ae'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info Sep 28 15:23:18 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Delete snapshot completed successfully. Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-dadb9a59-130e-47f7-905b-f4637e2df185 tempest-ProjectReaderTests-179599538 None] Lock "cinder-dd10864f-8b2e-427e-9bf1-b799376d4fd6-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-f49056b7-5136-42f4-87a1-bec834306007-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Lock "cinder-f49056b7-5136-42f4-87a1-bec834306007-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-f49056b7-5136-42f4-87a1-bec834306007" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-f49056b7-5136-42f4-87a1-bec834306007" acquired by "delete_volume" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc42135a-1067-45aa-817e-15dd89154d72]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info" returned: 0 in 0.297s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info is being set with open permissions: ugo+rw Sep 28 15:23:18 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info Sep 28 15:23:18 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 Sep 28 15:23:18 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.info" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5b8328bf-fe9e-464b-8030-85f87b2b22e4 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:23:19 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007" returned: 0 in 0.389s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007 Sep 28 15:23:19 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f49056b7-5136-42f4-87a1-bec834306007" returned: 0 in 0.251s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-f49056b7-5136-42f4-87a1-bec834306007" released by "delete_volume" :: held 0.705s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Created reservations ['b01f62c4-2df8-4051-b6aa-0d6f66bd6893', 'a84c2d46-b034-4d40-9865-0ddef18b74cc', 'b6795860-de0f-4ef5-b4cb-0d75232e9acd', '225dc730-f093-44d6-b114-aad997ab4905'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:19 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.268s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:19 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Deleted volume successfully. Sep 28 15:23:19 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2556fc50-2808-483a-be33-e949d14845f6 tempest-ProjectReaderTests-179599538 None] Lock "cinder-f49056b7-5136-42f4-87a1-bec834306007-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-be5af542-40b4-4729-aef7-3dd79630f201-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-be5af542-40b4-4729-aef7-3dd79630f201-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-be5af542-40b4-4729-aef7-3dd79630f201" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-be5af542-40b4-4729-aef7-3dd79630f201" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot be5af542-40b4-4729-aef7-3dd79630f201 of volume 0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8185dc7-45d8-4aa8-8efe-30dbe7324dab]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 Sep 28 15:23:20 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (a904d47c-9237-4532-8bf8-e959b5378f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780fa1c7-8391-4297-97ce-5db4dcef21a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780fa1c7-8391-4297-97ce-5db4dcef21a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188983710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce626df5-3745-4c3f-a6eb-abb5e9c4895a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:20Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c414f5-6c0f-4f6f-aa2c-febe90b0b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c414f5-6c0f-4f6f-aa2c-febe90b0b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18d31a0-965b-4411-86c5-5d990fd30b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18d31a0-965b-4411-86c5-5d990fd30b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce626df5-3745-4c3f-a6eb-abb5e9c4895a', 'volume_name': 'volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a9540f-eb9c-44bc-b687-6f324f5dc6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a9540f-eb9c-44bc-b687-6f324f5dc6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33873182-58ca-4199-bed2-5016865d883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Volume ce626df5-3745-4c3f-a6eb-abb5e9c4895a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a', 'volume_size': 1} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188983710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce626df5-3745-4c3f-a6eb-abb5e9c4895a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:20Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Creating volume ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:20 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a 1073741824 Sep 28 15:23:20 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201" returned: 0 in 0.400s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4cd20b-d574-4ae5-814b-c54e8b94560a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:20 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 Sep 28 15:23:20 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a 1073741824" returned: 0 in 0.482s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a Sep 28 15:23:21 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" returned: 0 in 0.417s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 Sep 28 15:23:21 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33873182-58ca-4199-bed2-5016865d883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb387222-e2aa-48ee-9012-ad56a79dae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:21 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Volume volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a (ce626df5-3745-4c3f-a6eb-abb5e9c4895a): created successfully Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb387222-e2aa-48ee-9012-ad56a79dae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (a904d47c-9237-4532-8bf8-e959b5378f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-59c08607-557d-4e4e-9d8e-54832d3a2664 tempest-ProjectReaderTests-179599538 None] Created volume successfully. Sep 28 15:23:21 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201 Sep 28 15:23:21 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48.be5af542-40b4-4729-aef7-3dd79630f201" returned: 0 in 0.266s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-be5af542-40b4-4729-aef7-3dd79630f201" released by "_delete_snapshot" :: held 1.564s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" released by "delete_snapshot" :: held 1.588s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Created reservations ['83af6dee-601d-4c96-beee-21b5b7e969cf', '08c4f9b0-0ef2-4335-924f-6e327dee3871', '75d6e1d5-951b-4ad8-a096-eafbcf77a305', 'b9c78d71-2e1e-4627-9d6d-8e2515e4353e'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:21 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:23:21 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-17efcf6e-448e-4121-ad60-086b48e21255 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-be5af542-40b4-4729-aef7-3dd79630f201-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-0b5c487f-8cd2-485c-92f5-44bcadc4ea48-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-0b5c487f-8cd2-485c-92f5-44bcadc4ea48-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" acquired by "delete_volume" :: waited 0.015s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[264ce95a-ca70-4d7a-bfd5-c413c7761cef]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 Sep 28 15:23:22 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Creating offline snapshot c82f0a7e-c20f-42db-b3d3-9a30151069fe of volume ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17aeb15-c5ec-49c0-856a-375a8d1f5616]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" returned: 0 in 0.428s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:22 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a Sep 28 15:23:22 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48 Sep 28 15:23:22 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" returned: 0 in 0.268s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" returned: 0 in 0.410s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-0b5c487f-8cd2-485c-92f5-44bcadc4ea48" released by "delete_volume" :: held 0.800s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:23 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe 1G Sep 28 15:23:23 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Created reservations ['3d835904-ae95-4ac9-a04e-387496f5220f', 'dc02c611-1db8-4ecb-99c0-29615bb063ec', 'b7b87222-7152-4719-99b2-1044523070b4', '1d47f68e-daa0-42dd-82e1-9fc54c6ed475'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:23 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.287s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:23 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:23:23 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-79110cd5-548c-402e-8a7a-61e9a55addf4 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-0b5c487f-8cd2-485c-92f5-44bcadc4ea48-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe 1G" returned: 0 in 0.492s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe Sep 28 15:23:23 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe" returned: 0 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe is being set with open permissions: ugo+rw Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe Sep 28 15:23:24 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (a8930e77-6a9f-420e-a91d-a264329e924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025f780f-e6a4-4655-b806-a444941c7221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025f780f-e6a4-4655-b806-a444941c7221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219162993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc9e474-2c1b-4f1f-ac30-51ac156de049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:24Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fda0f3-949c-43b2-91d6-c4c67bc153a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fda0f3-949c-43b2-91d6-c4c67bc153a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f739b-6e63-403e-ad92-0a0e479ecce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f739b-6e63-403e-ad92-0a0e479ecce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc9e474-2c1b-4f1f-ac30-51ac156de049', 'volume_name': 'volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420603b-1ab0-4ef9-b1ac-102448750ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420603b-1ab0-4ef9-b1ac-102448750ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d579dc1f-7835-4c50-942b-51f7778285c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Volume dfc9e474-2c1b-4f1f-ac30-51ac156de049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049', 'volume_size': 1} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe" returned: 0 in 0.270s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info Sep 28 15:23:24 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info" returned: 0 in 0.258s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info is being set with open permissions: ugo+rw Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info Sep 28 15:23:24 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.info" returned: 0 in 0.274s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219162993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc9e474-2c1b-4f1f-ac30-51ac156de049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:24Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Creating volume dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:24 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:24 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 1073741824 Sep 28 15:23:24 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-586bd96a-4ce2-4cf8-8409-884e1cfbc1d3 tempest-ProjectReaderTests-179599538 None] Create snapshot completed successfully Sep 28 15:23:25 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 1073741824" returned: 0 in 0.452s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:25 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 Sep 28 15:23:25 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:25 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049" returned: 0 in 0.248s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d579dc1f-7835-4c50-942b-51f7778285c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b733f63-5be4-480d-a2ba-9a7c344491cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Volume volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 (dfc9e474-2c1b-4f1f-ac30-51ac156de049): created successfully Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b733f63-5be4-480d-a2ba-9a7c344491cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (a8930e77-6a9f-420e-a91d-a264329e924c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:25 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5756129d-dd76-47af-9f6a-65141e0e5382 tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-c82f0a7e-c20f-42db-b3d3-9a30151069fe-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Lock "cinder-c82f0a7e-c20f-42db-b3d3-9a30151069fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:25 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-c82f0a7e-c20f-42db-b3d3-9a30151069fe" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-c82f0a7e-c20f-42db-b3d3-9a30151069fe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Deleting offline snapshot c82f0a7e-c20f-42db-b3d3-9a30151069fe of volume ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] snapshot_file for this snap is: volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cd15b6-3da2-4f50-b9d8-04d13651d3c9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe Sep 28 15:23:26 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot ecc1eb40-7de6-48d8-afc3-a1096411e7dd of volume dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[0877a505-552a-448d-91ff-c87aaa9284b7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe" returned: 0 in 0.426s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc26f7fc-b858-40db-ac74-ee7996a21787]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 Sep 28 15:23:26 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a Sep 28 15:23:26 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049" returned: 0 in 0.415s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd 1G Sep 28 15:23:26 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" returned: 0 in 0.437s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:26 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe Sep 28 15:23:26 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd 1G" returned: 0 in 0.454s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:27 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd Sep 28 15:23:27 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe" returned: 0 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:27 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe Sep 28 15:23:27 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd" returned: 0 in 0.348s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd is being set with open permissions: ugo+rw Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:27 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd Sep 28 15:23:27 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a.c82f0a7e-c20f-42db-b3d3-9a30151069fe" returned: 0 in 0.327s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-c82f0a7e-c20f-42db-b3d3-9a30151069fe" released by "_delete_snapshot" :: held 1.712s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" released by "delete_snapshot" :: held 1.737s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Created reservations ['9902785a-5baf-4574-ae7d-0512450ff78e', 'eb858fcc-ea8b-4feb-839b-31196bab1306', '6ffea00f-9e2b-4f2b-8fdb-de2b3864b180', '5d7697b6-2200-4b7a-affa-8819117c3b11'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:27 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Delete snapshot completed successfully. Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f782911d-4ecc-4a2b-8bf0-9cabcb06c837 tempest-ProjectReaderTests-179599538 None] Lock "cinder-c82f0a7e-c20f-42db-b3d3-9a30151069fe-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:27 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd" returned: 0 in 0.312s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info Sep 28 15:23:28 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-ce626df5-3745-4c3f-a6eb-abb5e9c4895a-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Lock "cinder-ce626df5-3745-4c3f-a6eb-abb5e9c4895a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" acquired by "delete_volume" :: waited 0.024s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b435a6-23e1-4a52-932d-fe61abdf108a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info" returned: 0 in 0.295s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info is being set with open permissions: ugo+rw Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info Sep 28 15:23:28 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a Sep 28 15:23:28 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.info" returned: 0 in 0.287s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:28 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ba522ad1-ffe4-4997-9c79-aa6c8e6ccbdd tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:23:28 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" returned: 0 in 0.418s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a Sep 28 15:23:28 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" returned: 0 in 0.277s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-ce626df5-3745-4c3f-a6eb-abb5e9c4895a" released by "delete_volume" :: held 0.763s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Created reservations ['02488638-7e6e-4f1e-8d27-f28d4fdaefe4', '63feedb3-2de5-4a76-83e4-eeb588e89ab0', '4e2eddc1-4d11-4d8d-9f53-9cab51035af9', '69d76c23-9aab-49d0-9412-468b4c9ab58f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:29 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:29 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.293s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:29 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Deleted volume successfully. Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-8969e11d-998a-4743-ba2b-7a630844ab1f tempest-ProjectReaderTests-179599538 None] Lock "cinder-ce626df5-3745-4c3f-a6eb-abb5e9c4895a-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-ecc1eb40-7de6-48d8-afc3-a1096411e7dd-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-ecc1eb40-7de6-48d8-afc3-a1096411e7dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-dfc9e474-2c1b-4f1f-ac30-51ac156de049" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-dfc9e474-2c1b-4f1f-ac30-51ac156de049" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-ecc1eb40-7de6-48d8-afc3-a1096411e7dd" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-ecc1eb40-7de6-48d8-afc3-a1096411e7dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot ecc1eb40-7de6-48d8-afc3-a1096411e7dd of volume dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[80131136-bc7b-4462-ba20-809927463428]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd Sep 28 15:23:29 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (0c9845b5-a04c-4c67-bde7-cfc24ec7d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d08866-3478-4a1e-af2a-073279faecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d08866-3478-4a1e-af2a-073279faecce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706569131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e92c84-88c9-4259-b1bf-fef67c9ffba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:30Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461dfd81-9bd4-41a9-8aa7-459cc3fc5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461dfd81-9bd4-41a9-8aa7-459cc3fc5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69270c-bd85-4ce3-8518-79bef420284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69270c-bd85-4ce3-8518-79bef420284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e92c84-88c9-4259-b1bf-fef67c9ffba9', 'volume_name': 'volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685a7ac7-4d29-4299-9f77-894e80cda17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685a7ac7-4d29-4299-9f77-894e80cda17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5e63bf-0e5f-45e1-883b-0be57c8052f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Volume e6e92c84-88c9-4259-b1bf-fef67c9ffba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9', 'volume_size': 1} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706569131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e92c84-88c9-4259-b1bf-fef67c9ffba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:30Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Creating volume e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:29 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:29 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 1073741824 Sep 28 15:23:30 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd" returned: 0 in 0.423s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41730e-b637-4bef-ba5d-19640aa5a7a6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 Sep 28 15:23:30 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 1073741824" returned: 0 in 0.509s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 Sep 28 15:23:30 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049" returned: 0 in 0.439s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd Sep 28 15:23:30 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" returned: 0 in 0.307s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5e63bf-0e5f-45e1-883b-0be57c8052f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10612499-ea17-4344-b344-d2a59c764641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:30 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Volume volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 (e6e92c84-88c9-4259-b1bf-fef67c9ffba9): created successfully Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10612499-ea17-4344-b344-d2a59c764641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:30 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (0c9845b5-a04c-4c67-bde7-cfc24ec7d64b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:30 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-797504ce-02d7-4373-8683-a59437c74c5b tempest-ProjectReaderTests-179599538 None] Created volume successfully. Sep 28 15:23:31 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:31 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd Sep 28 15:23:31 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:31 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049.ecc1eb40-7de6-48d8-afc3-a1096411e7dd" returned: 0 in 0.261s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-ecc1eb40-7de6-48d8-afc3-a1096411e7dd" released by "_delete_snapshot" :: held 1.619s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-dfc9e474-2c1b-4f1f-ac30-51ac156de049" released by "delete_snapshot" :: held 1.649s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Created reservations ['8f301cb6-775d-4fe7-9b7b-012ca1232607', '252b8fd5-e41a-45d8-93be-ed166526bb8e', '5a79db3c-706b-4aea-befd-4e95b2db11a8', 'ee9891ae-c5ad-4ad9-9368-8e86dca756af'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:31 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d90b3093-8ebe-474c-92a8-290d4dad0873 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-ecc1eb40-7de6-48d8-afc3-a1096411e7dd-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-dfc9e474-2c1b-4f1f-ac30-51ac156de049-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-dfc9e474-2c1b-4f1f-ac30-51ac156de049-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-dfc9e474-2c1b-4f1f-ac30-51ac156de049" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-dfc9e474-2c1b-4f1f-ac30-51ac156de049" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[17186dc7-82a0-4d5e-9531-00dd7243877a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:31 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 Sep 28 15:23:32 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Creating offline snapshot 060192d9-0a55-46c2-beb0-e631febe6b59 of volume e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7b6ab3-a1f6-451b-9275-a05658e42941]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 Sep 28 15:23:32 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049" returned: 0 in 0.460s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049 Sep 28 15:23:32 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" returned: 0 in 0.419s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-dfc9e474-2c1b-4f1f-ac30-51ac156de049" returned: 0 in 0.299s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 1G Sep 28 15:23:32 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-dfc9e474-2c1b-4f1f-ac30-51ac156de049" released by "delete_volume" :: held 0.836s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Created reservations ['cd631eea-7323-4709-8b03-ab4b5ac33b45', 'b1495f4d-88fc-4198-9e96-a99c262e4f17', '16e00ff7-f383-4539-b3fb-8bf81db42da1', 'bfaaa5f2-a376-45ac-82b2-c6c108caea0d'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:32 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:32 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 1G" returned: 0 in 0.525s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.350s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:33 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:23:33 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 Sep 28 15:23:33 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-d805012e-f6b6-4712-b51f-9c5601945551 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-dfc9e474-2c1b-4f1f-ac30-51ac156de049-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:33 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59" returned: 0 in 0.375s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 is being set with open permissions: ugo+rw Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 Sep 28 15:23:33 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (3b687c88-b5fa-419e-b687-f5a3d7c34649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacee9f2-3656-4734-aac3-bbffb8f883ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacee9f2-3656-4734-aac3-bbffb8f883ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438652748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:34Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0dbc445-0061-4479-8fd3-91ea9bb697b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0dbc445-0061-4479-8fd3-91ea9bb697b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89e5377-56d9-43a0-af6b-96699cdbe47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89e5377-56d9-43a0-af6b-96699cdbe47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6', 'volume_name': 'volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c785d1b-fac9-4c70-95b0-75627501533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c785d1b-fac9-4c70-95b0-75627501533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7e97a3-5bf0-4be5-8d32-d071e7ecf6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Volume a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6', 'volume_size': 1} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:33 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59" returned: 0 in 0.274s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info Sep 28 15:23:33 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info" returned: 0 in 0.256s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info is being set with open permissions: ugo+rw Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info Sep 28 15:23:34 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.info" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438652748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:34Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Creating volume a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:34 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 1073741824 Sep 28 15:23:34 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e25ec976-58a0-4840-bbf2-07a834ab117d tempest-ProjectReaderTests-179599538 None] Create snapshot completed successfully Sep 28 15:23:34 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 1073741824" returned: 0 in 0.457s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 Sep 28 15:23:34 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" returned: 0 in 0.250s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7e97a3-5bf0-4be5-8d32-d071e7ecf6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded41c10-b634-49ba-8b2a-8a13356f2936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:35 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Volume volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 (a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6): created successfully Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded41c10-b634-49ba-8b2a-8a13356f2936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (3b687c88-b5fa-419e-b687-f5a3d7c34649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:35 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-afa24e5d-e16b-4bbd-a761-2f6557d6e89f tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-060192d9-0a55-46c2-beb0-e631febe6b59-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Lock "cinder-060192d9-0a55-46c2-beb0-e631febe6b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-060192d9-0a55-46c2-beb0-e631febe6b59" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-060192d9-0a55-46c2-beb0-e631febe6b59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Deleting offline snapshot 060192d9-0a55-46c2-beb0-e631febe6b59 of volume e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] snapshot_file for this snap is: volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe852ec-d91a-45ac-bf71-5c4d6b972e4f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 Sep 28 15:23:35 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:35 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot a2bc77b0-bc7c-4296-b6de-bf6408718edc of volume a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59" returned: 0 in 0.470s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[5811b5c5-6137-44af-9eed-d0346428b1d9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55beccc-cbb0-4560-b9d7-e12218f3e935]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 Sep 28 15:23:36 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 Sep 28 15:23:36 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" returned: 0 in 0.394s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" returned: 0 in 0.397s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc 1G Sep 28 15:23:36 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 Sep 28 15:23:36 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59" returned: 0 in 0.390s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59 Sep 28 15:23:36 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc 1G" returned: 0 in 0.455s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc Sep 28 15:23:36 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9.060192d9-0a55-46c2-beb0-e631febe6b59" returned: 0 in 0.311s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-060192d9-0a55-46c2-beb0-e631febe6b59" released by "_delete_snapshot" :: held 1.682s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" released by "delete_snapshot" :: held 1.710s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=224,cinder:SELECT=160,cinder:DELETE=25,cinder:INSERT=58 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=185,cinder:UPDATE=220,cinder:INSERT=59,cinder:DELETE=14 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:37 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc" returned: 0 in 0.377s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc is being set with open permissions: ugo+rw Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Created reservations ['84b99d5c-bc48-4f42-b261-5b2413023265', 'b9e9a67f-dcb0-4b29-a4f9-6a2f4ac1ba5a', '78fe62c3-734a-4075-be65-dd76478546fd', '46a84da6-a998-4d8f-94fd-21c58cc3af26'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:37 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc Sep 28 15:23:37 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Delete snapshot completed successfully. Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-2126ac14-86f9-4373-9b05-af1126bd4b80 tempest-ProjectReaderTests-179599538 None] Lock "cinder-060192d9-0a55-46c2-beb0-e631febe6b59-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:37 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc" returned: 0 in 0.298s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info Sep 28 15:23:37 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-e6e92c84-88c9-4259-b1bf-fef67c9ffba9-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Lock "cinder-e6e92c84-88c9-4259-b1bf-fef67c9ffba9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:37 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.320s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" acquired by "delete_volume" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb17d54d-6510-4671-bab8-8137f6935422]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info" returned: 0 in 0.336s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info is being set with open permissions: ugo+rw Sep 28 15:23:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 Sep 28 15:23:37 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info Sep 28 15:23:37 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.info" returned: 0 in 0.299s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:38 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" returned: 0 in 0.447s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9 Sep 28 15:23:38 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-652e78fd-7382-4a81-b2ba-23d57e3e7eb2 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:23:38 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" returned: 0 in 0.313s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-e6e92c84-88c9-4259-b1bf-fef67c9ffba9" released by "delete_volume" :: held 0.840s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Created reservations ['a5669716-2714-4f45-adec-ee96518fedc4', '18e1ed3d-bbb4-4a8d-9206-33bf3b48c13b', 'ab5f28f0-7ee7-41b4-9631-ffaf44a987fd', '34cb200b-63db-41d8-999a-33ec3d91b629'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:38 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.276s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:38 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Deleted volume successfully. Sep 28 15:23:38 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-bb696d0e-05d2-4dfc-9666-f827224f531f tempest-ProjectReaderTests-179599538 None] Lock "cinder-e6e92c84-88c9-4259-b1bf-fef67c9ffba9-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-a2bc77b0-bc7c-4296-b6de-bf6408718edc-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-a2bc77b0-bc7c-4296-b6de-bf6408718edc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-a2bc77b0-bc7c-4296-b6de-bf6408718edc" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-a2bc77b0-bc7c-4296-b6de-bf6408718edc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot a2bc77b0-bc7c-4296-b6de-bf6408718edc of volume a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f947a-1041-4e49-9fcb-a26b53d5bcd0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (49b70c40-1570-4b21-8a1f-971d4d6509c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:39 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc Sep 28 15:23:39 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392dfc44-52ea-4208-87a4-194a7af16442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392dfc44-52ea-4208-87a4-194a7af16442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314107924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269f278c-810f-4f04-8f67-f6fdb42473b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:39Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee2c317-e587-420c-9b37-979d98c6111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee2c317-e587-420c-9b37-979d98c6111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3783675d-f831-4c2b-8ba4-c124742f5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3783675d-f831-4c2b-8ba4-c124742f5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269f278c-810f-4f04-8f67-f6fdb42473b2', 'volume_name': 'volume-269f278c-810f-4f04-8f67-f6fdb42473b2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866040cb-263e-47e9-9e11-e150165282b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866040cb-263e-47e9-9e11-e150165282b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1155e3ad-7ab6-4624-9df3-32ae48d66763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Volume 269f278c-810f-4f04-8f67-f6fdb42473b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269f278c-810f-4f04-8f67-f6fdb42473b2', 'volume_size': 1} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314107924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269f278c-810f-4f04-8f67-f6fdb42473b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a426fe4b3190404f97e1be1be650c5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:39Z,use_quota=True,user_id='ac109dfec5664289becc3b7ba2f6ed7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Creating volume 269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:39 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 1073741824 Sep 28 15:23:39 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc" returned: 0 in 0.418s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f185350-7662-46d6-9b75-eb1a43d03f58]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 Sep 28 15:23:39 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 1073741824" returned: 0 in 0.538s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 Sep 28 15:23:40 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" returned: 0 in 0.460s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc Sep 28 15:23:40 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2" returned: 0 in 0.290s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1155e3ad-7ab6-4624-9df3-32ae48d66763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269f278c-810f-4f04-8f67-f6fdb42473b2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11283c4-828f-40ea-a917-68163dfa98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Volume volume-269f278c-810f-4f04-8f67-f6fdb42473b2 (269f278c-810f-4f04-8f67-f6fdb42473b2): created successfully Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11283c4-828f-40ea-a917-68163dfa98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Flow 'volume_create_manager' (49b70c40-1570-4b21-8a1f-971d4d6509c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4fb3d449-7c2f-427b-943a-92333c49fd3a tempest-ProjectReaderTests-179599538 None] Created volume successfully. Sep 28 15:23:40 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc" returned: 0 in 0.368s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc Sep 28 15:23:40 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6.a2bc77b0-bc7c-4296-b6de-bf6408718edc" returned: 0 in 0.264s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-a2bc77b0-bc7c-4296-b6de-bf6408718edc" released by "_delete_snapshot" :: held 1.628s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" released by "delete_snapshot" :: held 1.653s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Created reservations ['1d9aaf0b-e0bf-485a-8a05-ea27adb5b57f', '45477b9c-46ed-489c-be01-d9913823a070', '76ae4150-fff2-4316-a23d-2b28b2e531c4', '759509da-6f25-4e5c-8181-77b1829227bc'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:23:40 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1dbd6845-baca-4de6-8372-c836ed0ad986 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-a2bc77b0-bc7c-4296-b6de-bf6408718edc-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Lock "cinder-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7571937e-6f4c-4e30-b132-6f92f30f411b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 Sep 28 15:23:41 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Creating offline snapshot 73ab1280-e580-4adc-83c3-5648c40566c2 of volume 269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[890cde71-df0a-4daa-b9de-4a09b42b948f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 Sep 28 15:23:41 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" returned: 0 in 0.403s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6 Sep 28 15:23:41 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2" returned: 0 in 0.387s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 1G Sep 28 15:23:42 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" returned: 0 in 0.276s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6" released by "delete_volume" :: held 0.769s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Created reservations ['d7999b29-25fc-4ec4-bb38-672d431f9ca3', 'b6ddc70e-dfef-4e5e-beed-26f49c381f84', '96a2cca1-3fd2-45ce-99bf-89b8ff79e7c0', '387a4836-185b-4d6b-bbfa-adeb42a40615'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:42 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 1G" returned: 0 in 0.516s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269f278c-810f-4f04-8f67-f6fdb42473b2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269f278c-810f-4f04-8f67-f6fdb42473b2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 Sep 28 15:23:42 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.296s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:42 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-3d15b509-c309-4098-a54d-831ae00bc4cf tempest-ProjectMemberTests-1662612173 None] Lock "cinder-a5d1fe9c-b374-49dd-aa11-3f29d8da2ad6-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:42 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269f278c-810f-4f04-8f67-f6fdb42473b2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2" returned: 0 in 0.380s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 is being set with open permissions: ugo+rw Sep 28 15:23:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 Sep 28 15:23:43 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (da97503b-88a7-4e88-89e7-1e6847e86945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e8e677-237b-4080-b107-f33fa58fd132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e8e677-237b-4080-b107-f33fa58fd132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831643817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b3745e-f572-4199-9b40-b52e7d6dd2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:43Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08ece2c-74ef-4c92-9fca-8c6a0756f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08ece2c-74ef-4c92-9fca-8c6a0756f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e18575-24e1-4af9-b800-b4e1d45cde63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e18575-24e1-4af9-b800-b4e1d45cde63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b3745e-f572-4199-9b40-b52e7d6dd2c5', 'volume_name': 'volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c9ebca-1f96-4311-a418-db8d59a63960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c9ebca-1f96-4311-a418-db8d59a63960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3eaafe-313d-4b9b-8d23-057e28e21d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Volume 49b3745e-f572-4199-9b40-b52e7d6dd2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5', 'volume_size': 1} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:43 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2" returned: 0 in 0.292s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info Sep 28 15:23:43 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info" returned: 0 in 0.269s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info is being set with open permissions: ugo+rw Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info Sep 28 15:23:43 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.info" returned: 0 in 0.259s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831643817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b3745e-f572-4199-9b40-b52e7d6dd2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:43Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Creating volume 49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:43 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 1073741824 Sep 28 15:23:43 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ea7c6f30-8606-4280-ab00-e50cfeee89a9 tempest-ProjectReaderTests-179599538 None] Create snapshot completed successfully Sep 28 15:23:44 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 1073741824" returned: 0 in 0.493s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:44 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 Sep 28 15:23:44 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:44 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5" returned: 0 in 0.296s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3eaafe-313d-4b9b-8d23-057e28e21d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24603ab-a15a-4ae7-9732-3f18b12f0cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:44 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Volume volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 (49b3745e-f572-4199-9b40-b52e7d6dd2c5): created successfully Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24603ab-a15a-4ae7-9732-3f18b12f0cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (da97503b-88a7-4e88-89e7-1e6847e86945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:44 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-799f39d4-b105-480a-9a90-7554cb037552 tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-73ab1280-e580-4adc-83c3-5648c40566c2-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Lock "cinder-73ab1280-e580-4adc-83c3-5648c40566c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-269f278c-810f-4f04-8f67-f6fdb42473b2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-269f278c-810f-4f04-8f67-f6fdb42473b2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-73ab1280-e580-4adc-83c3-5648c40566c2" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-73ab1280-e580-4adc-83c3-5648c40566c2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Deleting offline snapshot 73ab1280-e580-4adc-83c3-5648c40566c2 of volume 269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] snapshot_file for this snap is: volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd8ce6-5dd5-4021-87a3-c664afbe3497]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 Sep 28 15:23:45 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot 13646713-54e7-45d1-a815-5488b8c030b2 of volume 49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aa4ff7-4db8-4105-9271-ac0f90894231]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2" returned: 0 in 0.444s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269f278c-810f-4f04-8f67-f6fdb42473b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7709cb-8445-474e-8e1e-a8e8c7ecd86e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 Sep 28 15:23:45 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 Sep 28 15:23:45 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5" returned: 0 in 0.434s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 1G Sep 28 15:23:45 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2" returned: 0 in 0.496s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 Sep 28 15:23:46 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 1G" returned: 0 in 0.517s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 Sep 28 15:23:46 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2" returned: 0 in 0.481s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2 Sep 28 15:23:46 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 is being set with open permissions: ugo+rw Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 Sep 28 15:23:46 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2.73ab1280-e580-4adc-83c3-5648c40566c2" returned: 0 in 0.333s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-73ab1280-e580-4adc-83c3-5648c40566c2" released by "_delete_snapshot" :: held 1.885s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-269f278c-810f-4f04-8f67-f6fdb42473b2" released by "delete_snapshot" :: held 1.915s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:46 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Created reservations ['558cd17f-050e-4c07-b65d-171dafb1faf9', '60c22e91-7efd-4975-9ca3-50fade410e00', '30f2337a-8f80-404b-a335-c9af3f260b16', '1f3de4cc-d789-41db-b381-981bd7d0df29'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Delete snapshot completed successfully. Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-a2214cec-bace-491e-9297-66758f36a256 tempest-ProjectReaderTests-179599538 None] Lock "cinder-73ab1280-e580-4adc-83c3-5648c40566c2-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:47 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2" returned: 0 in 0.351s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-269f278c-810f-4f04-8f67-f6fdb42473b2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Lock "cinder-269f278c-810f-4f04-8f67-f6fdb42473b2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info Sep 28 15:23:47 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Acquiring lock "cinder-quobyte-269f278c-810f-4f04-8f67-f6fdb42473b2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-269f278c-810f-4f04-8f67-f6fdb42473b2" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80a26c1-900b-4b64-be5b-a215c33a4b49]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 Sep 28 15:23:47 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info" returned: 0 in 0.327s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info is being set with open permissions: ugo+rw Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info Sep 28 15:23:47 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2" returned: 0 in 0.500s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2 Sep 28 15:23:47 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.info" returned: 0 in 0.357s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:47 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-a4aabf12-e039-45cd-8d87-f74674513f40 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:23:48 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-269f278c-810f-4f04-8f67-f6fdb42473b2" returned: 0 in 0.371s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Lock "cinder-quobyte-269f278c-810f-4f04-8f67-f6fdb42473b2" released by "delete_volume" :: held 0.966s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Created reservations ['f75f0e58-d9b9-4be3-ad0c-ba8909d4a1fc', '39185217-5da5-49dc-b14c-03c9b26b0996', 'd3fd376e-213e-401e-b4b8-64da24410f26', 'f2bb1f01-35b6-4f99-b0d1-eb53bc1a774b'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:48 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-13646713-54e7-45d1-a815-5488b8c030b2-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.269s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Lock "cinder-13646713-54e7-45d1-a815-5488b8c030b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-49b3745e-f572-4199-9b40-b52e7d6dd2c5" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Deleted volume successfully. Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-49b3745e-f572-4199-9b40-b52e7d6dd2c5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-13646713-54e7-45d1-a815-5488b8c030b2" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4fba682d-3ed0-4bc7-8fc1-9d43d4eff935 tempest-ProjectReaderTests-179599538 None] Lock "cinder-269f278c-810f-4f04-8f67-f6fdb42473b2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-13646713-54e7-45d1-a815-5488b8c030b2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot 13646713-54e7-45d1-a815-5488b8c030b2 of volume 49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f8e2e-9d68-4566-9555-2ff596011bb2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:48 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 Sep 28 15:23:48 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2" returned: 0 in 0.368s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1619401-0d6d-467c-8392-4fa7e48ac143]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 Sep 28 15:23:49 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5" returned: 0 in 0.393s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 Sep 28 15:23:49 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2" returned: 0 in 0.407s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2 Sep 28 15:23:49 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5.13646713-54e7-45d1-a815-5488b8c030b2" returned: 0 in 0.259s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-13646713-54e7-45d1-a815-5488b8c030b2" released by "_delete_snapshot" :: held 1.546s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-49b3745e-f572-4199-9b40-b52e7d6dd2c5" released by "delete_snapshot" :: held 1.576s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Created reservations ['29bdbb56-5990-49db-82c6-b256367e86c1', 'e2cac489-874d-410f-854e-388492ebb7f9', 'd1037199-8617-4352-8ca5-69ae99aa050f', '36d91d5e-c4bd-4d0a-9654-56760e844b3f'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:50 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-f11e34b6-d134-4ade-b486-90c72dc60fda tempest-ProjectMemberTests-1662612173 None] Lock "cinder-13646713-54e7-45d1-a815-5488b8c030b2-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-49b3745e-f572-4199-9b40-b52e7d6dd2c5-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Lock "cinder-49b3745e-f572-4199-9b40-b52e7d6dd2c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-49b3745e-f572-4199-9b40-b52e7d6dd2c5" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-49b3745e-f572-4199-9b40-b52e7d6dd2c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e63d43-2185-47b1-bfce-aaba553fedcf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:50 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 Sep 28 15:23:51 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5" returned: 0 in 0.462s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5 Sep 28 15:23:51 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-49b3745e-f572-4199-9b40-b52e7d6dd2c5" returned: 0 in 0.301s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-49b3745e-f572-4199-9b40-b52e7d6dd2c5" released by "delete_volume" :: held 0.851s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Created reservations ['3cce4096-699e-4e72-a357-17cccaecb4e7', 'f6cc9e21-852e-44a3-8c8c-4e7342986577', 'e7c43049-b08d-457a-b8df-19b4d87c3997', '80af83e9-c523-4b45-9b24-2947dbef0e39'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:23:51 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.285s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:52 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-ba240698-2a2b-4c4c-be33-c9734242eaca tempest-ProjectMemberTests-1662612173 None] Lock "cinder-49b3745e-f572-4199-9b40-b52e7d6dd2c5-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (146569e3-db47-46ff-9a05-15307477d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fa6488-dc16-4b14-be49-7b3b0381baf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fa6488-dc16-4b14-be49-7b3b0381baf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105520530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0db5fc-18a3-469c-8fef-c22669b8dafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:53Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c55e06c-7b08-4d3a-85ad-fa4a172d5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c55e06c-7b08-4d3a-85ad-fa4a172d5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fc953f-1344-4947-982e-51b011cfb73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fc953f-1344-4947-982e-51b011cfb73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0db5fc-18a3-469c-8fef-c22669b8dafc', 'volume_name': 'volume-da0db5fc-18a3-469c-8fef-c22669b8dafc', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851186fd-cf03-4e8b-a87d-7392e76ace8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851186fd-cf03-4e8b-a87d-7392e76ace8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fffad83-d858-46f9-8b43-a349cc85d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:52 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Volume da0db5fc-18a3-469c-8fef-c22669b8dafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0db5fc-18a3-469c-8fef-c22669b8dafc', 'volume_size': 1} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105520530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0db5fc-18a3-469c-8fef-c22669b8dafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:53Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Creating volume da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:52 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:23:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc 1073741824 Sep 28 15:23:52 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc 1073741824" returned: 0 in 0.515s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:53 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc Sep 28 15:23:53 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc" returned: 0 in 0.307s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fffad83-d858-46f9-8b43-a349cc85d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0db5fc-18a3-469c-8fef-c22669b8dafc', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3a36f0-0fab-4945-8591-e86304c12010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:53 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Volume volume-da0db5fc-18a3-469c-8fef-c22669b8dafc (da0db5fc-18a3-469c-8fef-c22669b8dafc): created successfully Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3a36f0-0fab-4945-8591-e86304c12010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:53 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (146569e3-db47-46ff-9a05-15307477d92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-932eb747-7d7c-489f-926d-8832de63ef86 tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:23:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot 93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 of volume da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fcdc98-354f-4569-9a1a-3b2f48be9982]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc Sep 28 15:23:55 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc" returned: 0 in 0.412s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 1G Sep 28 15:23:55 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 1G" returned: 0 in 0.444s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0db5fc-18a3-469c-8fef-c22669b8dafc -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0db5fc-18a3-469c-8fef-c22669b8dafc -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 Sep 28 15:23:55 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0db5fc-18a3-469c-8fef-c22669b8dafc -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" returned: 0 in 0.310s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 is being set with open permissions: ugo+rw Sep 28 15:23:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 Sep 28 15:23:56 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" returned: 0 in 0.272s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info Sep 28 15:23:56 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info" returned: 0 in 0.313s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info is being set with open permissions: ugo+rw Sep 28 15:23:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info Sep 28 15:23:56 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.info" returned: 0 in 0.289s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:57 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-78c8315b-f08e-47c9-a78a-3885e8e84991 tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-93f47da9-04c4-4ccf-a34d-da6aabf9fdf2-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-93f47da9-04c4-4ccf-a34d-da6aabf9fdf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-da0db5fc-18a3-469c-8fef-c22669b8dafc" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-da0db5fc-18a3-469c-8fef-c22669b8dafc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot 93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 of volume da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[4153ae16-d5d9-4d28-a846-a3cd1b2a736b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:58 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 Sep 28 15:23:58 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:58 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" returned: 0 in 0.427s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da0db5fc-18a3-469c-8fef-c22669b8dafc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1b84d-b392-4785-906b-27fe178e094c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:58 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:58 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc Sep 28 15:23:58 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:59 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc" returned: 0 in 0.416s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:59 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 Sep 28 15:23:59 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:59 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" returned: 0 in 0.419s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:59 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2 Sep 28 15:23:59 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:59 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc.93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" returned: 0 in 0.300s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-93f47da9-04c4-4ccf-a34d-da6aabf9fdf2" released by "_delete_snapshot" :: held 1.686s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-da0db5fc-18a3-469c-8fef-c22669b8dafc" released by "delete_snapshot" :: held 1.710s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:59 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Created reservations ['743d8ae1-0aed-4aba-80c6-d99a0bf166df', '33ad23d2-5eda-409e-ab37-266141e554d1', '4b073234-2f6e-42e7-86d2-0a392ca8b602', '007cc38a-304b-4a9a-ba96-a457634166e8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:00 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-62055e7d-9f5a-4165-9c17-a766085f9837 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-93f47da9-04c4-4ccf-a34d-da6aabf9fdf2-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-da0db5fc-18a3-469c-8fef-c22669b8dafc-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-da0db5fc-18a3-469c-8fef-c22669b8dafc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-da0db5fc-18a3-469c-8fef-c22669b8dafc" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-da0db5fc-18a3-469c-8fef-c22669b8dafc" acquired by "delete_volume" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d10b44-410c-4ed0-9c9c-cd87b15e33b4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc Sep 28 15:24:00 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc" returned: 0 in 0.442s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc Sep 28 15:24:00 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-da0db5fc-18a3-469c-8fef-c22669b8dafc" returned: 0 in 0.257s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-da0db5fc-18a3-469c-8fef-c22669b8dafc" released by "delete_volume" :: held 0.779s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Created reservations ['e7539f60-2c17-4b14-af06-b51f3f32bd33', '597a03a1-9d39-450d-8777-fe22e23f3728', '78bb9f4d-8e74-42e5-a0f4-aacd517db7da', '57946c84-cf3f-4dcf-9187-9990b08898b1'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:01 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:24:01 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.276s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:01 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:24:01 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-e2f1d04b-9857-4fda-bfa8-0a5b04406901 tempest-ProjectMemberTests-1662612173 None] Lock "cinder-da0db5fc-18a3-469c-8fef-c22669b8dafc-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (e0b43bff-0915-4d83-ad83-230fa6ab3ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bcb5d5-c997-4394-9f7f-8abdbaae2d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bcb5d5-c997-4394-9f7f-8abdbaae2d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419140254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca92f529-d778-481d-9634-5fcabd227fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:02Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd0d6c6-7df5-423b-b04e-087f8efc87ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd0d6c6-7df5-423b-b04e-087f8efc87ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e17060-aa0d-4fc3-bbdc-0ea83e695cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e17060-aa0d-4fc3-bbdc-0ea83e695cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca92f529-d778-481d-9634-5fcabd227fb2', 'volume_name': 'volume-ca92f529-d778-481d-9634-5fcabd227fb2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c8da5b-af12-40cf-bcbb-c448805cff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c8da5b-af12-40cf-bcbb-c448805cff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493edf99-6824-42c4-bef8-752879facc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Volume ca92f529-d778-481d-9634-5fcabd227fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca92f529-d778-481d-9634-5fcabd227fb2', 'volume_size': 1} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419140254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca92f529-d778-481d-9634-5fcabd227fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefaa6ce02a848309121af1a363c93e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:02Z,use_quota=True,user_id='b2281e34dd924fb4a1a5015e7f0833c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Creating volume ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:02 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:02 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 1073741824 Sep 28 15:24:02 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:02 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 1073741824" returned: 0 in 0.450s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:02 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 Sep 28 15:24:02 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:02 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2" returned: 0 in 0.248s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493edf99-6824-42c4-bef8-752879facc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca92f529-d778-481d-9634-5fcabd227fb2', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81bef86-bd21-4b3e-a1d8-d27a06eb455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:02 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Volume volume-ca92f529-d778-481d-9634-5fcabd227fb2 (ca92f529-d778-481d-9634-5fcabd227fb2): created successfully Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81bef86-bd21-4b3e-a1d8-d27a06eb455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:02 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Flow 'volume_create_manager' (e0b43bff-0915-4d83-ad83-230fa6ab3ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:02 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-5c5f3e65-14c0-4a77-82f6-f3461c1841fe tempest-ProjectMemberTests-1662612173 None] Created volume successfully. Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Creating offline snapshot fa30db0d-807d-426a-8648-d5bda6d861b2 of volume ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b435e586-e084-4c6d-9ea0-249668f4ba95]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:03 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 Sep 28 15:24:03 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:03 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2" returned: 0 in 0.403s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:03 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:03 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 1G Sep 28 15:24:03 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 1G" returned: 0 in 0.438s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca92f529-d778-481d-9634-5fcabd227fb2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca92f529-d778-481d-9634-5fcabd227fb2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 Sep 28 15:24:04 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca92f529-d778-481d-9634-5fcabd227fb2 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2" returned: 0 in 0.309s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 is being set with open permissions: ugo+rw Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 Sep 28 15:24:04 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2" returned: 0 in 0.248s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info Sep 28 15:24:04 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info" returned: 0 in 0.252s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info is being set with open permissions: ugo+rw Sep 28 15:24:04 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info Sep 28 15:24:04 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:05 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.info" returned: 0 in 0.260s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:05 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-3ef4ae2d-9ca4-40f2-9971-4fc0c02b17be tempest-ProjectMemberTests-1662612173 None] Create snapshot completed successfully Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-fa30db0d-807d-426a-8648-d5bda6d861b2-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Lock "cinder-fa30db0d-807d-426a-8648-d5bda6d861b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-ca92f529-d778-481d-9634-5fcabd227fb2" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-ca92f529-d778-481d-9634-5fcabd227fb2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-fa30db0d-807d-426a-8648-d5bda6d861b2" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-fa30db0d-807d-426a-8648-d5bda6d861b2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Deleting offline snapshot fa30db0d-807d-426a-8648-d5bda6d861b2 of volume ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] snapshot_file for this snap is: volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd69103-6099-464c-be0a-ab5c8990a521]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:05 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:05 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 Sep 28 15:24:05 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2" returned: 0 in 0.448s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca92f529-d778-481d-9634-5fcabd227fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa49b8-e754-4028-871f-7cda86b6c4fc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 Sep 28 15:24:06 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2" returned: 0 in 0.427s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 Sep 28 15:24:06 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2 Sep 28 15:24:06 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2.fa30db0d-807d-426a-8648-d5bda6d861b2" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-fa30db0d-807d-426a-8648-d5bda6d861b2" released by "_delete_snapshot" :: held 1.630s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-ca92f529-d778-481d-9634-5fcabd227fb2" released by "delete_snapshot" :: held 1.662s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Created reservations ['8d1def86-320c-45d6-af66-63cf211e2261', '174c185c-2af1-4c61-a512-a7cece167a81', '72d2cfb0-9246-47c1-937f-cf6dd3fd7035', '74da9fec-6b87-445b-9364-8571b963e614'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:07 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Delete snapshot completed successfully. Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-1a86cfae-39d4-4d21-a9e8-0c21e8603d4d tempest-ProjectMemberTests-1662612173 None] Lock "cinder-fa30db0d-807d-426a-8648-d5bda6d861b2-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-ca92f529-d778-481d-9634-5fcabd227fb2-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Lock "cinder-ca92f529-d778-481d-9634-5fcabd227fb2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Acquiring lock "cinder-quobyte-ca92f529-d778-481d-9634-5fcabd227fb2" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-ca92f529-d778-481d-9634-5fcabd227fb2" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[993358d1-9ea4-4035-8b78-4aa7ea520e45]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:07 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 Sep 28 15:24:07 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2" returned: 0 in 0.388s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2 Sep 28 15:24:08 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-ca92f529-d778-481d-9634-5fcabd227fb2" returned: 0 in 0.274s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Lock "cinder-quobyte-ca92f529-d778-481d-9634-5fcabd227fb2" released by "delete_volume" :: held 0.744s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Created reservations ['6b6039d0-72ef-446b-8f05-d9fa5cfa2229', '10cd0979-7762-4eab-acf2-5ecf129aabe1', '0f107167-88dd-4a6c-8ad1-52409753bc46', '78c5c849-7d48-4066-807e-d5c985d4a528'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:24:08 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.262s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:08 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Deleted volume successfully. Sep 28 15:24:08 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-9486e5c3-1476-44ff-910f-73020f75e64a tempest-ProjectMemberTests-1662612173 None] Lock "cinder-ca92f529-d778-481d-9634-5fcabd227fb2-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:18 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=73,cinder:UPDATE=106,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:18 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=78,cinder:INSERT=31,cinder:UPDATE=94,cinder:DELETE=9 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:37 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:24:37 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:37 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.280s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG oslo_service.periodic_task [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87124) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread count: 29 {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:24:37 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-7c8bd875-4133-456f-a1fa-2771870747e5 None None] thread info: [<_MainThread(MainThread, started 128458275209344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87124) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Flow 'volume_create_manager' (788ccd6f-4ad5-4d16-a505-d8d030de33e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56466df-f78c-42ab-bff2-a31261e9b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56466df-f78c-42ab-bff2-a31261e9b61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-509945685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9272356-e215-4f11-8b16-441d14909441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ffe4a9dd1841afa2aca166362bb4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='0b456b8802bb4ab2ae0946863b81f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238680ba-61e0-4ca5-b80d-7045fc9a9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238680ba-61e0-4ca5-b80d-7045fc9a9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dba126a-ae47-4900-8c43-859406d4d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dba126a-ae47-4900-8c43-859406d4d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9272356-e215-4f11-8b16-441d14909441', 'volume_name': 'volume-f9272356-e215-4f11-8b16-441d14909441', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb170ac8-1d73-479e-a71a-85edf9eb0b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb170ac8-1d73-479e-a71a-85edf9eb0b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468229f4-a1e3-4ad0-94e8-8fb0c334447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Volume f9272356-e215-4f11-8b16-441d14909441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9272356-e215-4f11-8b16-441d14909441', 'volume_size': 1} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-509945685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9272356-e215-4f11-8b16-441d14909441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ffe4a9dd1841afa2aca166362bb4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='0b456b8802bb4ab2ae0946863b81f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)}" {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Creating volume f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:40 devstack cinder-volume[87124]: INFO cinder.volume.drivers.remotefs [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] casted to osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 1073741824 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 1073741824 Sep 28 15:24:40 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 1073741824" returned: 0 in 0.436s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 Sep 28 15:24:40 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441" returned: 0 in 0.251s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'} {{(pid=87124) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468229f4-a1e3-4ad0-94e8-8fb0c334447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9272356-e215-4f11-8b16-441d14909441', 'volume_size': 1}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b366d0-2162-476d-9a00-91c72bc5d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Volume volume-f9272356-e215-4f11-8b16-441d14909441 (f9272356-e215-4f11-8b16-441d14909441): created successfully Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b366d0-2162-476d-9a00-91c72bc5d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Flow 'volume_create_manager' (788ccd6f-4ad5-4d16-a505-d8d030de33e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:40 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-e8bef5e7-beb6-49c0-93a3-6010ba1240d7 tempest-SnapshotDependencyTests-1807029034 None] Created volume successfully. Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Creating offline snapshot 8a038d4b-adb9-43b6-bad5-6163c397bb39 of volume f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b40f20b-8d35-42c1-9558-f0b86bbc34a6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 Sep 28 15:24:41 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441" returned: 0 in 0.381s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 1G {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 1G Sep 28 15:24:41 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 1G" returned: 0 in 0.403s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9272356-e215-4f11-8b16-441d14909441 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9272356-e215-4f11-8b16-441d14909441 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 Sep 28 15:24:42 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9272356-e215-4f11-8b16-441d14909441 -F qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39" returned: 0 in 0.295s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 is being set with open permissions: ugo+rw Sep 28 15:24:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 Sep 28 15:24:42 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39" returned: 0 in 0.238s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info Sep 28 15:24:42 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info" returned: 0 in 0.254s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info is being set with open permissions: ugo+rw Sep 28 15:24:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:43 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info Sep 28 15:24:43 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.info" returned: 0 in 0.245s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:43 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-d207456b-41f6-4c3d-8723-9f1e00b0696c tempest-SnapshotDependencyTests-1807029034 None] Create snapshot completed successfully Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.flows.manager.create_volume [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87124) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Flow 'volume_create_manager' (46b3d681-4ffd-4416-bb14-758f3bd11829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2504d4-78ef-4f47-aca0-be8b82044813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2504d4-78ef-4f47-aca0-be8b82044813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51161409-420c-4c7d-9624-e1a52e2a815b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ffe4a9dd1841afa2aca166362bb4e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a038d4b-adb9-43b6-bad5-6163c397bb39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:44Z,use_quota=True,user_id='0b456b8802bb4ab2ae0946863b81f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3fd8355-a12e-4776-90e2-d12f9c8cfce6),volume_type_id=d3fd8355-a12e-4776-90e2-d12f9c8cfce6)' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce41874-504e-4450-ada3-4d075d2e7551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce41874-504e-4450-ada3-4d075d2e7551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574f3eb2-da9c-4144-8e21-d63e54a28f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574f3eb2-da9c-4144-8e21-d63e54a28f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51161409-420c-4c7d-9624-e1a52e2a815b', 'volume_name': 'volume-51161409-420c-4c7d-9624-e1a52e2a815b', 'volume_size': 1, 'snapshot_id': '8a038d4b-adb9-43b6-bad5-6163c397bb39'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1c809c-573e-45d5-980e-41ad46c8994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1c809c-573e-45d5-980e-41ad46c8994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c348a73-1948-4da0-ba32-2706b847db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Volume 51161409-420c-4c7d-9624-e1a52e2a815b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51161409-420c-4c7d-9624-e1a52e2a815b', 'volume_size': 1, 'snapshot_id': '8a038d4b-adb9-43b6-bad5-6163c397bb39'} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-quobyte-8a038d4b-adb9-43b6-bad5-6163c397bb39-51161409-420c-4c7d-9624-e1a52e2a815b" by "_create_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-8a038d4b-adb9-43b6-bad5-6163c397bb39-51161409-420c-4c7d-9624-e1a52e2a815b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Creating volume 51161409-420c-4c7d-9624-e1a52e2a815b from snapshot 8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Selected osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794 as target Quobyte volume. {{(pid=87124) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-quobyte-51161409-420c-4c7d-9624-e1a52e2a815b" by "_copy_volume_from_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-51161409-420c-4c7d-9624-e1a52e2a815b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] snapshot: 8a038d4b-adb9-43b6-bad5-6163c397bb39, volume: 51161409-420c-4c7d-9624-e1a52e2a815b, {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e7d54-a1d1-4218-8279-819a7ac27529]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 Sep 28 15:24:44 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9272356-e215-4f11-8b16-441d14909441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeefa83-2481-49c9-939f-a99a0353c15e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:44 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 Sep 28 15:24:44 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:45 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441" returned: 0 in 0.378s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:24:45 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Creating direct copy from snapshot {{(pid=87124) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:24:45 devstack cinder-volume[87124]: DEBUG cinder.utils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Path /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b not found in is_blk_device check {{(pid=87124) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:24:45 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:45 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b Sep 28 15:24:45 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b" returned: 0 in 5.995s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.image.image_utils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b {{(pid=87124) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:24:51 devstack cinder-volume[87124]: INFO cinder.image.image_utils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Converted 1024.00 MB image at 170.78 MB/s Sep 28 15:24:51 devstack cinder-volume[87124]: WARNING cinder.volume.drivers.remotefs [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b is being set with open permissions: ugo+rw Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b Sep 28 15:24:51 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b" returned: 0 in 0.277s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-51161409-420c-4c7d-9624-e1a52e2a815b" released by "_copy_volume_from_snapshot" :: held 7.114s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-8a038d4b-adb9-43b6-bad5-6163c397bb39-51161409-420c-4c7d-9624-e1a52e2a815b" released by "_create_volume_from_snapshot" :: held 7.182s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.197s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c348a73-1948-4da0-ba32-2706b847db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51161409-420c-4c7d-9624-e1a52e2a815b', 'volume_size': 1, 'snapshot_id': '8a038d4b-adb9-43b6-bad5-6163c397bb39'}' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42fa39-6b99-41ca-8b6b-261d3af8ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:51 devstack cinder-volume[87124]: INFO cinder.volume.flows.manager.create_volume [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Volume volume-51161409-420c-4c7d-9624-e1a52e2a815b (51161409-420c-4c7d-9624-e1a52e2a815b): created successfully Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42fa39-6b99-41ca-8b6b-261d3af8ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87124) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Flow 'volume_create_manager' (46b3d681-4ffd-4416-bb14-758f3bd11829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87124) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:51 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-393455e3-b275-4a65-8fcc-8d8727cdfba7 tempest-SnapshotDependencyTests-1807029034 None] Created volume successfully. Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-8a038d4b-adb9-43b6-bad5-6163c397bb39-delete_snapshot" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-8a038d4b-adb9-43b6-bad5-6163c397bb39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-quobyte-f9272356-e215-4f11-8b16-441d14909441" by "delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-f9272356-e215-4f11-8b16-441d14909441" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-quobyte-8a038d4b-adb9-43b6-bad5-6163c397bb39" by "_delete_snapshot" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-8a038d4b-adb9-43b6-bad5-6163c397bb39" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Deleting offline snapshot 8a038d4b-adb9-43b6-bad5-6163c397bb39 of volume f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] snapshot_file for this snap is: volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbddb08c-0b6c-40ce-a9c0-951f74377a69]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:51 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 Sep 28 15:24:51 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:52 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39" returned: 0 in 0.372s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:52 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.remotefs [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9272356-e215-4f11-8b16-441d14909441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87124) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:52 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7743a11-9b85-4518-a2b4-4aa3b28d6dfb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:52 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 Sep 28 15:24:52 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:52 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441" returned: 0 in 0.596s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:52 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:52 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 Sep 28 15:24:52 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:53 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39" returned: 0 in 0.344s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:53 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39 Sep 28 15:24:53 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:53 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441.8a038d4b-adb9-43b6-bad5-6163c397bb39" returned: 0 in 0.273s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-8a038d4b-adb9-43b6-bad5-6163c397bb39" released by "_delete_snapshot" :: held 1.695s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-f9272356-e215-4f11-8b16-441d14909441" released by "delete_snapshot" :: held 1.721s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Created reservations ['d24abaab-de81-4fc7-8c5a-0841e26d3c5e', 'a94e851f-6fb5-46e9-b3aa-3c74f3e295d8', '8dcd6cf2-df61-464f-b82a-25c527228116', '1fc45a13-1c62-4a1f-97a6-061ebdd41ea8'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:53 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Delete snapshot completed successfully. Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-33be028b-8e50-463b-80b1-47d2e3cd82c6 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-8a038d4b-adb9-43b6-bad5-6163c397bb39-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:53 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-f9272356-e215-4f11-8b16-441d14909441-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-f9272356-e215-4f11-8b16-441d14909441-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-quobyte-f9272356-e215-4f11-8b16-441d14909441" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-f9272356-e215-4f11-8b16-441d14909441" acquired by "delete_volume" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc28fd60-cfd0-4996-9dcf-672822c367c0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 Sep 28 15:24:54 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441" returned: 0 in 0.358s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441 Sep 28 15:24:54 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-f9272356-e215-4f11-8b16-441d14909441" returned: 0 in 0.231s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-f9272356-e215-4f11-8b16-441d14909441" released by "delete_volume" :: held 0.656s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Created reservations ['6b324bd8-ba37-4542-b308-cfe392067309', 'bfcc5e09-0bf2-44ee-8f2f-3c44d67c3ff3', 'ff1fbe99-8a73-49c7-a339-d30708fbdc42', '2432a762-bc90-464a-a705-d027fa3b3cd5'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:54 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:24:54 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.250s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:55 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Deleted volume successfully. Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-4dbe51a5-1bae-43cd-aa74-235d7f35c293 tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-f9272356-e215-4f11-8b16-441d14909441-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-51161409-420c-4c7d-9624-e1a52e2a815b-delete_volume" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-51161409-420c-4c7d-9624-e1a52e2a815b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "cinder-quobyte-51161409-420c-4c7d-9624-e1a52e2a815b" by "delete_volume" {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-51161409-420c-4c7d-9624-e1a52e2a815b" acquired by "delete_volume" :: waited 0.017s {{(pid=87124) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo.privsep.daemon [-] privsep: reply[988440a9-c817-4563-be40-e9e94d468c6e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b Sep 28 15:24:55 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b" returned: 0 in 0.347s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b Sep 28 15:24:55 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528/volume-51161409-420c-4c7d-9624-e1a52e2a815b" returned: 0 in 0.248s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-quobyte-51161409-420c-4c7d-9624-e1a52e2a815b" released by "delete_volume" :: held 0.636s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.quota [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Created reservations ['f76654b4-4a82-4509-ab62-a0092cd1de90', 'e78b7c0a-6852-421b-9544-386260c661f7', '28bd80ef-2f7d-4c74-bdba-45bafc0781f2', '01fd221f-af6e-4504-8576-5826dc885739'] {{(pid=87124) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794': None} {{(pid=87124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG cinder.volume.drivers.quobyte [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-822a98c7-e8e0-4c1b-8662-4b67b2ad2794'] {{(pid=87124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.lockutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:55 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528 Sep 28 15:24:55 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:56 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:56 devstack cinder-volume[87124]: DEBUG oslo_concurrency.processutils [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a46fc249831061184df45686cabd528" returned: 0 in 0.265s {{(pid=87124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:56 devstack cinder-volume[87124]: DEBUG cinder.manager [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Notifying Schedulers of capabilities ... {{(pid=87124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:56 devstack cinder-volume[87124]: INFO cinder.volume.manager [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Deleted volume successfully. Sep 28 15:24:56 devstack cinder-volume[87124]: DEBUG cinder.coordination [None req-595eda46-22c4-42cd-abca-535f0554983f tempest-SnapshotDependencyTests-1807029034 None] Lock "cinder-51161409-420c-4c7d-9624-e1a52e2a815b-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87124) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:05 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:SELECT=25,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:06 devstack cinder-volume[87124]: DEBUG dbcounter [-] [87124] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}